-- Logs begin at Thu 2022-09-01 14:19:51 UTC, end at Thu 2022-09-01 15:16:00 UTC. -- Sep 01 14:50:10.666751 dv-cinder-855058-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 14:50:10.678072 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 14:50:10.679213 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 14:50:10 2022] *** Sep 01 14:50:10.679213 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 14:50:10.679213 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 14:50:10.679213 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: nodename: dv-cinder-855058-2-iscsi Sep 01 14:50:10.679213 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: machine: x86_64 Sep 01 14:50:10.679213 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: clock source: unix Sep 01 14:50:10.679213 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: pcre jit disabled Sep 01 14:50:10.679213 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: detected number of CPU cores: 4 Sep 01 14:50:10.679213 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: current working directory: / Sep 01 14:50:10.679213 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: detected binary path: /usr/bin/uwsgi-core Sep 01 14:50:10.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: your processes number limit is 47680 Sep 01 14:50:10.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: your memory page size is 4096 bytes Sep 01 14:50:10.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: detected max file descriptor number: 2048 Sep 01 14:50:10.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: lock engine: pthread robust mutexes Sep 01 14:50:10.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: thunder lock: enabled Sep 01 14:50:10.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 14:50:10.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 14:50:10.718140 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: Python main interpreter initialized at 0x55ca819419c0 Sep 01 14:50:10.718140 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: python threads support enabled Sep 01 14:50:10.718140 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: your server socket listen backlog is limited to 100 connections Sep 01 14:50:10.718140 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: your mercy for graceful operations on workers is 90 seconds Sep 01 14:50:10.718488 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 14:50:10.718572 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: *** Operational MODE: preforking *** Sep 01 14:50:10.718802 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: *** uWSGI is running in multiple interpreter mode *** Sep 01 14:50:10.718802 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: spawned uWSGI master process (pid: 105350) Sep 01 14:50:10.718977 dv-cinder-855058-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 14:50:10.726604 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: spawned uWSGI worker 1 (pid: 105351, cores: 1) Sep 01 14:50:10.726604 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: spawned uWSGI worker 2 (pid: 105352, cores: 1) Sep 01 14:50:10.726604 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 14:50:11.374070 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 14:50:11.374703 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 14:50:12.446572 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:50:12.446572 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: from cryptography.utils import int_from_bytes Sep 01 14:50:12.447184 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:50:12.447184 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: from cryptography.utils import int_from_bytes Sep 01 14:50:12.448697 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:50:12.448697 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: from cryptography.utils import int_from_bytes Sep 01 14:50:12.449116 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:50:12.449116 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: from cryptography.utils import int_from_bytes Sep 01 14:50:14.899306 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 14:50:14.899904 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 14:50:14.900171 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 14:50:14.900537 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 14:50:14.900791 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 14:50:14.901176 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.901263 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 14:50:14.901616 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.901701 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 14:50:14.901809 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.902022 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 14:50:14.902121 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.902415 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 14:50:14.902521 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.902677 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 14:50:14.902767 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.903060 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.903157 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.903374 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.903463 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.903699 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.903796 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.903962 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.904059 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.904276 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.904363 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.904593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855058-2-iscsi {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.904688 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.904910 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.905001 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.905214 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.905302 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.905522 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.905611 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.905827 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.905976 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.906127 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.906228 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.906469 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.906581 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855058-2-iscsi {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.906770 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.906872 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.907628 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.907812 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.907933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.908241 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.908353 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.908546 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.908640 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.908860 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.909086 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.909230 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.909363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.909496 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.909666 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.909810 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.909981 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.910117 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.910311 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.910406 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.910627 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.910717 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.910968 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.911059 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.911282 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.911371 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855058-2-iscsi {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.911594 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.911683 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.911934 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.912092 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.912230 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.912319 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.912597 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.912701 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.912867 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.912997 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.913223 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.913312 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855058-2-iscsi {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.913540 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.913643 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.913857 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.913948 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.914163 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.914280 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.914512 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.914620 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.914827 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.914927 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.915142 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.915233 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.915457 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.915558 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.915755 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.915861 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.916057 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.916149 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.916363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.916454 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.916679 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.916779 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.916980 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.917072 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.917279 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.917370 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.917521 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.917662 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.917814 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.917973 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.918129 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.918309 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.918471 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.918636 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.918788 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.918946 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.919035 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.919252 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.919340 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.919512 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.919607 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.919822 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.919911 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.920147 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.920243 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.920456 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.920557 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.920758 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.920849 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.921022 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.921118 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.921275 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.921373 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.921597 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.921694 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.921914 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.922002 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.922214 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.922344 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.922571 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.922661 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.922882 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.922970 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.923193 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.923283 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.923495 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.923582 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.923802 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.923889 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.924111 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.924200 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.924420 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.924517 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.924719 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.924814 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.925043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.925138 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.925355 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.925450 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.925657 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.925747 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.925972 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.926104 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.926306 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.926400 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.926610 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.926709 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.926913 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.927004 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.927217 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.927306 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.927533 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.927631 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.927860 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.927955 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.928160 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.928290 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.928408 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.928512 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.928707 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.928794 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.929012 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.929109 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.929325 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.929426 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.929627 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.929723 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.929930 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.930020 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.930231 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.930349 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.930548 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.930637 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.930850 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.930947 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.931151 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.931248 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.931452 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.931541 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.931752 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.931841 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.932052 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.932142 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.932352 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.932450 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.932650 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.932738 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.932951 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.933053 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.933251 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.933340 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.933551 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.933640 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.933857 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.933945 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.934167 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.934322 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.934497 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.934602 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.934797 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.934893 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.935097 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.935187 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.935395 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.935485 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.935700 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.935794 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.935998 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.936086 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.936297 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.936397 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.936609 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.936697 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.936907 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.937004 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.937206 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.937299 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.937513 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.937601 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.937813 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.937907 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.938131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.938228 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.938471 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.938572 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.938766 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.938855 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.939072 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.939169 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.939378 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.939474 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.939677 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.939765 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.939978 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.940076 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.940275 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.940372 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.940574 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.940670 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.940874 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.940972 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.941174 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.941263 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.941473 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.941568 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.941771 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.941861 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.942065 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.942162 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.942663 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.942759 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.942970 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.943091 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.943275 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.943378 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.943575 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.943672 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.943874 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.943970 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.944178 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.944265 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.944479 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.944573 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.944800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.944896 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.945124 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.945215 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.945436 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.945535 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.945745 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.945842 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.946054 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.946142 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.946398 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:50:14.946505 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.946711 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.946799 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.947023 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.947112 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.947348 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.947449 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.947660 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.947750 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.947969 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.948058 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.948279 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.948369 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.948594 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.948686 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.948914 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.949012 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.949241 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.949330 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.949555 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.949651 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.949868 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.949967 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.950182 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.950309 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.950514 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.950604 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.950830 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.950920 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.951149 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.951249 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.951463 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.951551 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.951769 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.951859 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.952101 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.952199 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.952423 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.952518 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.952735 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.952822 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.953054 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.953143 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.953371 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.953461 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.953678 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.954309 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.954530 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.954621 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.954840 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.954930 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.955180 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.955281 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.955493 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.955583 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.955803 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.955899 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.956121 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.956219 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.956430 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.956563 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.956740 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.956829 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.957046 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.957147 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.957353 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.957450 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.957662 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.957751 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.957969 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.958067 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.958297 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.958390 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.958620 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.958712 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.958930 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.959031 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.959252 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.959349 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.959561 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.959649 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.959870 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.959968 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.960184 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.960273 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.960492 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.960587 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.960799 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.960889 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.961105 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.961206 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.961408 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.961505 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.961710 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.961800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.962012 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.962101 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.962341 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.962433 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.962648 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.962741 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.962964 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.963061 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.963284 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.963389 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.963584 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.963673 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.963890 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.963983 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.964196 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.964294 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.964503 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.964591 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.964805 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.964916 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.965110 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.965212 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.965411 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.965501 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.965718 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.965807 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.966026 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.966128 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.966350 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.966444 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.966672 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.966762 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.966980 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.967078 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.967282 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.967378 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.967589 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.967687 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.967888 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.967984 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.968188 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.968285 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.968498 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.968593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.968805 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.968903 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.969110 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.969199 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.969976 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.970079 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.970297 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.970402 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.970620 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.970710 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.970932 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.971036 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.971239 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.971329 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.971567 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.971656 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.971889 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.971990 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.972190 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.972278 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.972510 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.972599 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.972832 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.972988 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.973142 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.973281 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.973419 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.973551 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.973721 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.973856 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.974022 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.974162 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.974346 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.974482 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.974643 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.974780 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.974939 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.975089 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.975226 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.975361 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.975529 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.975669 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.975829 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.975967 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.976129 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.976267 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.976417 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.976566 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.976732 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.976866 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.977038 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.977180 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.977329 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.977466 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.977621 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.977762 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.977896 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.978037 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.978265 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.978403 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.978551 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.978697 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.978879 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.978978 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.979209 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.979307 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.979515 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.979612 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.979823 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.979921 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.980130 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.980217 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.980444 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.980533 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.980751 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.980849 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.981059 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.981148 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.981368 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.981458 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.981677 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.981769 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.981992 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.982081 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.982319 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.982425 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.982638 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.982767 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.982947 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.983044 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.983264 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.983354 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.983572 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.983662 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.983883 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.983971 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.984183 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.984271 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.984496 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.984587 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.984818 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.984914 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.985169 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.985272 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.985481 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.985577 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.985801 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.985891 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.986108 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.986211 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.986442 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.986534 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.986747 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.986879 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.987053 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.987155 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.987356 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.987454 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.987663 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.987754 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.987978 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.988076 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.988284 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.988373 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.988596 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.988686 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.988903 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.989007 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.989226 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.989316 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.989530 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.989619 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.989840 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.989928 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.990139 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.990226 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.990474 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.990564 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.990796 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.990885 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.991111 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.991199 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.991417 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.991516 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.991723 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.991814 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.992040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.992129 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.992346 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.992434 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.992651 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.992739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.992960 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.993100 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.993260 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.993407 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.993545 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.993709 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.993845 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.993982 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.994152 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.994324 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.994470 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.994608 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.994780 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.994921 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.995070 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.995215 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.995380 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.995520 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.995687 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.995832 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.995969 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.996114 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.996273 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.996431 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.996568 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.996705 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.996883 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.997042 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.997181 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.997323 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.997492 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.997639 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.997813 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.997934 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.998112 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.998207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.998436 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.998529 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.998754 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.998902 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.999053 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.999191 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.999352 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.999498 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.999643 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.999779 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:14.999941 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.000078 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.000279 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.000437 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.000575 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.000749 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.000895 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.001045 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.001253 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.001399 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.001564 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.001703 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.001874 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.002012 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.002183 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.002311 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.002532 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.002621 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.002840 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.002936 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.003153 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.003250 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.003463 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.003551 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.003770 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.003859 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.004075 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.004176 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.004382 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.004482 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.004687 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.004783 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.004991 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.005095 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.005310 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.005400 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.005616 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.005706 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.005943 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.006052 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.006230 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.006399 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.006551 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.006641 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.006855 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.006945 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.007169 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.007261 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.007498 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.007726 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.007825 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.008055 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.008144 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.008368 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.008457 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.008686 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.008785 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.009006 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.009098 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.009327 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.009426 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.009652 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.009890 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.009988 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.010250 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.010353 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.010576 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.010672 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.010889 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.010978 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.011190 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.011280 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.011490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.011589 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.011798 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.011896 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.012099 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.012195 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.012400 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.012497 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.012703 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.012802 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.013010 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.013142 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.013309 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.013399 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.013608 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.013706 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.013909 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.014007 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.014211 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.014348 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.014544 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.014642 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.014843 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.014933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.015151 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.015248 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.015449 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.015539 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.015756 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.015843 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.016061 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.016149 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.016924 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.017030 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.017230 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.017323 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.017530 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.017621 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.017854 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.017943 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.018158 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.018267 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.018509 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.018598 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.018825 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.018915 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.019134 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.019226 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.019443 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.019542 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.019748 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.019836 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.020069 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.020167 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.020372 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.020471 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.020672 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.020762 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.020972 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.021061 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.021277 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.021375 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.021583 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.021672 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.021881 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.021971 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.022188 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.022297 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.022519 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.022609 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.022828 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.022918 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.023135 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.023225 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.023433 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.023523 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.023738 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.023828 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.024036 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.024126 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.024347 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.024437 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.024652 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.024741 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.024952 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.025043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.025251 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.025340 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.025554 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.025650 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.025856 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.025952 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.026154 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.026333 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.026485 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.026592 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.026782 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.026872 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.027089 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.027176 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.027387 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.027493 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.027685 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.027784 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.027983 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.028117 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.028290 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.028392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.028594 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.028690 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.028892 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.029034 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.029207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.029344 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.029511 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.029648 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.029814 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.029951 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.030095 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.030229 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.030427 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.030560 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.030711 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.030855 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.031001 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.031137 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.031305 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.031443 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.031624 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.031763 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.031986 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.032611 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.032750 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.032884 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.033057 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.033199 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.033347 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.033494 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.033628 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.033761 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.033929 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.034072 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.034286 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.034427 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.034565 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.034699 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.034835 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.035060 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.035197 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.035332 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.035466 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.035602 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.035736 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.035885 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.036021 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.036154 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.036288 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.036422 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.036566 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.036712 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.036859 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.036995 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.037156 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.037300 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.037495 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.037674 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.037810 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.037989 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.038128 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.038340 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.038487 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.038656 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.038794 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.038968 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.039058 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.039260 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.039412 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.039568 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.039707 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.039917 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.040056 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.040220 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.040375 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.040532 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.040665 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.040839 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.040987 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.041153 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.041291 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.041455 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.041592 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.041753 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.041891 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.042071 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.042211 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.042394 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.042530 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.042699 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.042848 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.043016 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.043163 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.043331 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.043502 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.043641 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.043795 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.043941 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.044077 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.044214 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.044349 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.044520 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.044666 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.044811 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.044946 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.045115 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.045204 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.045410 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.045509 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.045716 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.045805 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.046023 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.046148 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.046352 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.046457 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.046660 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.046750 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.046965 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.047055 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.047265 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.047364 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.047597 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.047699 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.047903 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.047993 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.048203 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.048337 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.048524 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.048615 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.048830 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.048919 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.049129 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.049230 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.049434 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.049525 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.049741 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.049830 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.050044 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.050132 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.050371 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.050465 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.050685 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.050784 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.051015 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.051112 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.051329 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.051418 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.051637 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.051744 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.051952 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.052041 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.052257 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.052344 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.052565 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.052663 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.052870 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.052958 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.053167 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.053296 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.053578 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.053677 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.053887 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.053977 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.054193 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.054323 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.054521 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.054620 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.054822 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.054912 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.055123 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.055213 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.055428 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.055519 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.055735 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.055831 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.056034 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.056157 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.056333 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.056473 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.056632 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.056788 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.056948 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.057102 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.057249 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.057410 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.057593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.057716 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.057973 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.058071 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.058302 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.058439 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.058607 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.058697 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.058963 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.059064 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.059271 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.059367 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.059597 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.059687 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.059907 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.060013 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.060224 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.060312 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.060546 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.060636 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.060851 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.060970 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.061161 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.061260 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.061469 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.061652 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.061789 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.061967 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.062109 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.062308 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.062441 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.062638 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.062753 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.062967 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.063056 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.063323 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.063415 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.063636 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.063725 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.063955 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.064053 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.064269 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.064359 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.064596 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.064685 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.064920 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.065022 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.065237 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.065328 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.065557 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.065646 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.065865 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.065962 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.066181 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.066290 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.066509 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.066610 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.066817 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.066918 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.067119 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.067215 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.067691 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.067816 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.068010 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.068147 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.068313 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.068463 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.068621 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.068789 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.068927 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.069119 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.069254 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.069432 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.069524 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.069742 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.069840 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.070057 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.070154 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.070388 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.070493 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.070705 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.070803 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.071031 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.071120 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.071338 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.071427 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.071650 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.071748 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.071949 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.072044 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.072263 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.072352 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.072570 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.072660 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.072872 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.072960 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.073172 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.073262 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.073472 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.073562 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.073809 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.073913 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.074110 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.074199 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.074456 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.074549 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.074779 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.074867 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.075091 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.075188 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.075395 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.075484 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.075719 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.075808 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.076029 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.076132 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.076339 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.076435 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.076650 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.076746 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.076972 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.077069 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.077275 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.077365 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.077578 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.077668 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.077886 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.077993 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.078187 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.078312 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.078512 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.078647 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.079328 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.079465 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.079637 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.079728 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.079941 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.080031 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.080248 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.080339 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.080550 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.080653 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.080869 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.080961 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.081170 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.081260 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.081488 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.081577 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.081792 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.081882 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.082093 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.082193 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.082419 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.082511 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.082718 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.082818 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.083040 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.083130 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.083347 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.083443 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.083653 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.083759 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.083964 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.084052 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.084272 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.084360 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.084583 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.084686 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.084893 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.084983 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.085198 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.085286 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.085505 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.085603 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.085812 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.085901 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.086119 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.086207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.086452 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.086544 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.086759 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.086849 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.087069 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.087158 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.087377 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.087468 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.087691 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.087788 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.088030 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.088203 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.088350 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.088528 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.088668 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.088840 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.088985 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.089150 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.089315 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.089461 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.089606 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.089758 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.089920 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.090066 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.090273 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.090405 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.090578 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.090714 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.090901 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.091020 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.091328 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.091418 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.091650 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.091739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.091967 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.092071 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.092288 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.092380 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.092617 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.092708 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.092931 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.093022 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.093243 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.093333 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.093553 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.093643 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.093863 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.093960 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.094175 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.094282 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.095065 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.095173 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.095377 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.095468 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.095690 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.095787 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.096002 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.096099 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.096311 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.096401 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.096620 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.096719 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.096929 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.097027 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.097239 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.097329 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.097549 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.097640 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.097858 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.097949 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.098164 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.098305 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.098498 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.098593 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.098811 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.098911 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.099131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.099235 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.099449 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.099538 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.099767 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.099861 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.100074 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.100163 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.100390 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.100492 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.100700 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.100789 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.101019 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.101217 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.101336 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.101533 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.101654 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.101866 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.101957 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.102290 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.102395 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.102620 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.102710 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.102935 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.103026 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.103250 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.103347 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.103567 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.103665 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.103871 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.103959 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.104174 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.104398 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.104488 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.104717 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.104814 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.105057 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.105147 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.105376 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.105465 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.105686 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.105775 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.105988 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.106101 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.106336 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.106438 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.106646 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.106735 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.106967 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.107170 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.107262 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.107512 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.107609 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.107825 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.107916 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.108150 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.108241 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.108473 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.108563 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.108785 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.108911 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.109087 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.109176 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.109405 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.109495 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.109711 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.109809 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.110035 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.110288 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.110384 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.110640 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.110731 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.110962 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.111052 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.111265 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.111360 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.111573 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.111671 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.111883 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.111974 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.112187 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.112284 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.112496 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.112585 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.112797 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.112887 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.113117 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.113206 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.113417 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.113515 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.113718 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.113809 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.114020 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.114163 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.114351 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.114457 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.114650 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.114747 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.114950 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.115040 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.115250 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.115352 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.115547 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.115645 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.115850 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.115941 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.116150 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.116248 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.116457 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.116547 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.116758 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.116847 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.117063 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.117159 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.117360 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.117448 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.117669 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.117758 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.117977 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.118068 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.118311 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.118405 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.118618 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.118707 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.118920 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.119056 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.119223 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.119312 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.119528 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.119617 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.119832 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.119925 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.120141 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.120230 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.120444 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.120539 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.120786 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.120876 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.121100 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.121190 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.121423 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.121625 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.121723 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.121957 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.122292 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.122384 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.122628 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.122718 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.122957 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.123047 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.123261 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.123358 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.123565 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.123663 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.123867 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.123958 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.124188 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.124279 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.124496 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.124741 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.124831 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.125084 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.125174 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.125398 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.125496 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.125731 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.125825 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.126040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.126132 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.126375 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.126481 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.126683 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.126775 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.126991 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.127082 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.127296 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.127387 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.127601 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.127691 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.127907 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.128010 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.128212 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.128340 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.128516 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.128607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.128826 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.128925 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.129139 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.129229 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.129453 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.129544 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.129772 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.129877 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.130071 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.130162 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.130409 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.130500 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.130716 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.130808 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.131020 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.131116 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.131328 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.131418 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.131634 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.131725 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.131944 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.132033 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.132269 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.132362 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.132578 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.132669 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.132879 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.132969 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.133200 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.133297 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.133521 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.133611 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.133834 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.133925 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.134148 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.134265 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.134485 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.134584 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.134799 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.134890 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.135116 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.135215 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.135422 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.135513 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.135741 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.135840 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.136049 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.136138 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.136371 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.136459 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.136705 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.136796 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.137029 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.137127 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.137347 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.137438 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.137651 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.137749 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.137952 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.138044 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.138284 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.138402 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.138578 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.138720 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.138896 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.139046 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.139212 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.139363 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.139510 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.139698 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.139812 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.140045 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.140147 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.140377 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.140475 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.140698 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.140796 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.140997 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.141086 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.141824 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.141922 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.142127 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.142219 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.142463 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.142572 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.142762 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.142861 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.143061 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.143151 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.143361 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.143451 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.143660 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.143762 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.143957 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.144053 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.144261 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.144364 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.144560 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.144675 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.144858 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.144956 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.145154 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.145250 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.145452 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.145550 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.145748 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.145844 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.146050 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.146138 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.146378 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.146471 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.146688 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.146777 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.146996 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.147085 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.147302 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.147392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.147615 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.147704 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.147918 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.148006 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.148223 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.148320 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.148528 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.148645 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.148834 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.148946 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.149137 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.149257 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.149464 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.149563 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.149769 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.149869 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.150077 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.150193 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.150405 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.150501 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.150717 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.150819 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.151023 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.151114 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.151328 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.151418 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.151647 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.151750 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.151969 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.152059 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.152269 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.152359 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.152583 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.152681 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.152892 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.152981 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.153206 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.153305 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.153517 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.153614 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.153820 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.153909 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.154132 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.154221 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.154460 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.154569 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.154765 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.154856 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.155069 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.155159 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.155374 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.155466 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.155679 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.155771 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.155990 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.156089 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.156293 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.156391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.156596 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.156687 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.157443 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.157552 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.157768 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.157858 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.158309 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.158449 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.158562 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.158692 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.158785 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.158876 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.159034 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.159161 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.159355 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.159447 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.159667 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.159764 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.160005 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.160097 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.160301 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.160400 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.160614 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.160714 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.160932 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.161037 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.161237 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.161327 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.161538 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.161628 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.161777 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 14:50:15.161877 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.162183 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.162537 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.162907 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.163220 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.163538 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.163888 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.164221 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.164539 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.164855 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.165166 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:50:15.165413 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 14:50:15.314625 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO dbcounter [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Registered counter for database nova_api Sep 01 14:50:15.317749 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO dbcounter [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Registered counter for database nova_api Sep 01 14:50:15.336947 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_db.sqlalchemy.engines [None req-99166611-5617-4e28-917e-4b028d0b340e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:50:15.338603 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG oslo_db.sqlalchemy.engines [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:50:15.343611 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writer thread running {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:50:15.345085 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG dbcounter [-] [105352] Writer thread running {{(pid=105352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:50:15.401087 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.context [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af77895d-00fc-418a-9eb2-bcc92f66925d(cell1) {{(pid=105351) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 14:50:15.401594 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.context [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af77895d-00fc-418a-9eb2-bcc92f66925d(cell1) {{(pid=105352) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 14:50:15.404950 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:50:15.405471 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG oslo_concurrency.lockutils [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:50:15.405608 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:50:15.405952 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG oslo_concurrency.lockutils [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:50:15.407129 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:50:15.407649 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG oslo_concurrency.lockutils [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:50:15.407900 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:50:15.408357 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:50:15.408619 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG oslo_concurrency.lockutils [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:50:15.409283 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG oslo_concurrency.lockutils [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:50:15.410439 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:50:15.411378 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG oslo_concurrency.lockutils [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105352) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:50:15.412518 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO dbcounter [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Registered counter for database nova_cell0 Sep 01 14:50:15.413358 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO dbcounter [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Registered counter for database nova_cell0 Sep 01 14:50:15.416534 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO dbcounter [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Registered counter for database nova_cell1 Sep 01 14:50:15.417254 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO dbcounter [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Registered counter for database nova_cell1 Sep 01 14:50:15.423685 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_db.sqlalchemy.engines [None req-99166611-5617-4e28-917e-4b028d0b340e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:50:15.425338 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG oslo_db.sqlalchemy.engines [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:50:15.428425 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG oslo_db.sqlalchemy.engines [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:50:15.429048 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writer thread running {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:50:15.430586 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_db.sqlalchemy.engines [None req-99166611-5617-4e28-917e-4b028d0b340e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:50:15.433855 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG dbcounter [-] [105352] Writer thread running {{(pid=105352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:50:15.435353 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG dbcounter [-] [105352] Writer thread running {{(pid=105352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:50:15.571947 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writer thread running {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:50:15.581099 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO dbcounter [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Registered counter for database nova_cell0 Sep 01 14:50:15.581224 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO dbcounter [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Registered counter for database nova_cell0 Sep 01 14:50:15.589188 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_db.sqlalchemy.engines [None req-99166611-5617-4e28-917e-4b028d0b340e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:50:15.592690 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG oslo_db.sqlalchemy.engines [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:50:15.593891 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writer thread running {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:50:15.597392 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG dbcounter [-] [105352] Writer thread running {{(pid=105352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:50:15.930974 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: WARNING keystonemiddleware.auth_token [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:50:15.934459 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: WARNING keystonemiddleware.auth_token [None req-99166611-5617-4e28-917e-4b028d0b340e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:50:15.938832 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: WARNING keystonemiddleware.auth_token [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:50:15.942624 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: WARNING keystonemiddleware.auth_token [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:50:16.281463 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: WARNING keystonemiddleware.auth_token [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:50:16.284216 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: WARNING keystonemiddleware.auth_token [None req-99166611-5617-4e28-917e-4b028d0b340e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:50:16.287886 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: WARNING keystonemiddleware.auth_token [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:50:16.290176 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: WARNING keystonemiddleware.auth_token [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:50:16.293107 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca819419c0 pid: 105352 (default app) Sep 01 14:50:16.295182 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:50:16.295400 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca819419c0 pid: 105351 (default app) Sep 01 14:50:16.296367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-998ec3de-29e4-42f5-ba46-d5c6546e7d3f None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Sep 01 14:50:16.296770 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Thu Sep 1 14:50:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:51:34.053205 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:51:34.054483 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-99166611-5617-4e28-917e-4b028d0b340e None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Sep 01 14:51:34.054949 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:51:34.066813 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG dbcounter [-] [105352] Writing DB stats nova_api:SELECT=3 {{(pid=105352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:51:34.068418 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG dbcounter [-] [105352] Writing DB stats nova_cell0:SELECT=3 {{(pid=105352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:51:34.069387 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG dbcounter [-] [105352] Writing DB stats nova_cell1:SELECT=3 {{(pid=105352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:51:34.070605 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG dbcounter [-] [105352] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:51:34.965170 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-0ff7410e-de44-49f9-a5aa-b0cf187beaa1 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:51:34.996661 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-0ff7410e-de44-49f9-a5aa-b0cf187beaa1 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.935763 Sep 01 14:51:34.997389 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Sep 1 14:51:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:51:37.359545 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-99166611-5617-4e28-917e-4b028d0b340e None None] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:51:37.360485 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-99166611-5617-4e28-917e-4b028d0b340e None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 Sep 01 14:51:37.362636 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:51:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:51:37.796211 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-28723e3d-781e-428d-ae83-6e02d65ccb5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1, "disk": 1}} {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:37.848250 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-28723e3d-781e-428d-ae83-6e02d65ccb5c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.481396 Sep 01 14:51:37.850282 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 1 14:51:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:51:37.862618 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_api:SELECT=3 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:51:37.863822 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_cell0:SELECT=3 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:51:37.865177 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_cell1:SELECT=3 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:51:37.866192 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:51:38.074954 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-28cec2a4-8aec-4afa-8ee2-29b1d250afc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:38.138905 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-28cec2a4-8aec-4afa-8ee2-29b1d250afc1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281566 Sep 01 14:51:38.139511 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Sep 1 14:51:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:51:40.491210 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-28723e3d-781e-428d-ae83-6e02d65ccb5c admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:51:40.492779 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-28723e3d-781e-428d-ae83-6e02d65ccb5c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002148 Sep 01 14:51:40.493334 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:51:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:51:41.155679 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-9bd817e1-7f57-45c2-91e4-2ea65d0818d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:41.194742 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-9bd817e1-7f57-45c2-91e4-2ea65d0818d5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.694574 Sep 01 14:51:41.195673 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 1 14:51:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:51:41.210690 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-62b9dcc7-5d67-426e-9afd-2acd9fed0fef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:41.247277 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-62b9dcc7-5d67-426e-9afd-2acd9fed0fef admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041784 Sep 01 14:51:41.247882 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Sep 1 14:51:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:51:43.632157 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-9bd817e1-7f57-45c2-91e4-2ea65d0818d5 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:51:43.633233 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-9bd817e1-7f57-45c2-91e4-2ea65d0818d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Sep 01 14:51:43.633639 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:51:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:51:44.029739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-83ed75a4-3fab-4af0-8502-f7006c992673 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "swap": 0, "id": "d2", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:44.047931 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-83ed75a4-3fab-4af0-8502-f7006c992673 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.408213 Sep 01 14:51:44.049051 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 1 14:51:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:51:44.062027 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-2acd1c6b-1d38-4af0-8fa6-859cd199b5f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:44.086184 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-2acd1c6b-1d38-4af0-8fa6-859cd199b5f5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028450 Sep 01 14:51:44.086781 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Sep 1 14:51:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:51:46.429354 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-83ed75a4-3fab-4af0-8502-f7006c992673 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:51:46.430968 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-83ed75a4-3fab-4af0-8502-f7006c992673 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002037 Sep 01 14:51:46.431370 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:51:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:51:46.890658 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-b4e4b4c1-604b-4c36-82d3-104b8b4ccf6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:46.909575 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-b4e4b4c1-604b-4c36-82d3-104b8b4ccf6e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471814 Sep 01 14:51:46.910114 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 1 14:51:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:51:46.922082 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-45a9e035-eb98-4fe0-b0f7-f02b62d72e8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:46.946896 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-45a9e035-eb98-4fe0-b0f7-f02b62d72e8f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028469 Sep 01 14:51:46.954666 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Sep 1 14:51:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:51:49.282536 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-b4e4b4c1-604b-4c36-82d3-104b8b4ccf6e admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:51:49.283450 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-b4e4b4c1-604b-4c36-82d3-104b8b4ccf6e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 01 14:51:49.284846 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:51:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:51:49.727286 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-3e49e8e1-d1fd-4b86-b533-344db18252f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:49.746151 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-3e49e8e1-d1fd-4b86-b533-344db18252f6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455955 Sep 01 14:51:49.747012 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 1 14:51:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:51:49.759375 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-b9efb989-b8c9-4f85-b87d-0ffbd45fd93d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:49.785353 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-b9efb989-b8c9-4f85-b87d-0ffbd45fd93d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029560 Sep 01 14:51:49.785927 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Sep 1 14:51:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:51:52.115597 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-3e49e8e1-d1fd-4b86-b533-344db18252f6 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:51:52.116486 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-3e49e8e1-d1fd-4b86-b533-344db18252f6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 01 14:51:52.116904 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:51:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:51:52.527773 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-9c3c4e93-7f5a-45c4-b389-5834afaf30a9 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:51:52.553097 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-9c3c4e93-7f5a-45c4-b389-5834afaf30a9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.430125 Sep 01 14:51:52.553638 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Sep 1 14:51:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:51:54.961142 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-3e49e8e1-d1fd-4b86-b533-344db18252f6 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:51:54.962077 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-3e49e8e1-d1fd-4b86-b533-344db18252f6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 01 14:51:54.962690 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:51:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:51:55.402573 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-05fddb91-2a6f-44e3-8bfc-8ac382b2ca2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:55.425773 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-05fddb91-2a6f-44e3-8bfc-8ac382b2ca2f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.454948 Sep 01 14:51:55.427087 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 1 14:51:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:51:55.442418 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-6d4cddd0-c9bf-46fb-b7dd-9fa29192b150 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:55.468540 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-6d4cddd0-c9bf-46fb-b7dd-9fa29192b150 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030563 Sep 01 14:51:55.469113 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Sep 1 14:51:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:51:57.919709 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-05fddb91-2a6f-44e3-8bfc-8ac382b2ca2f admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:51:57.920738 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-05fddb91-2a6f-44e3-8bfc-8ac382b2ca2f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 01 14:51:57.921147 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:51:58.314426 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-b78ea3ed-876d-476d-acad-204324828f24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small"}} {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:58.333559 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-b78ea3ed-876d-476d-acad-204324828f24 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.406118 Sep 01 14:51:58.334210 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 1 14:51:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:51:58.346157 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-e6bcf27e-9a5e-4485-8e8c-5316ea063e57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:51:58.370626 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-e6bcf27e-9a5e-4485-8e8c-5316ea063e57 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028082 Sep 01 14:51:58.371177 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Sep 1 14:51:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:52:00.706100 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-b78ea3ed-876d-476d-acad-204324828f24 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:00.707162 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-b78ea3ed-876d-476d-acad-204324828f24 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Sep 01 14:52:00.707745 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:52:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:01.093568 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-90fc6889-dfcc-4e54-b50e-75e3f49f53d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "id": "3"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:52:01.113149 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-90fc6889-dfcc-4e54-b50e-75e3f49f53d4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.399655 Sep 01 14:52:01.113697 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 1 14:52:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:52:01.126141 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-7744f162-c043-4b54-9416-01d36a2ab845 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:52:01.153499 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-7744f162-c043-4b54-9416-01d36a2ab845 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031360 Sep 01 14:52:01.154258 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Sep 1 14:52:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:52:03.507949 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-90fc6889-dfcc-4e54-b50e-75e3f49f53d4 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:03.509642 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-90fc6889-dfcc-4e54-b50e-75e3f49f53d4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Sep 01 14:52:03.510041 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:04.047634 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-22b99acc-4cc3-40f7-9584-939301937bea admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0}} {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:52:04.071179 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-22b99acc-4cc3-40f7-9584-939301937bea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.554498 Sep 01 14:52:04.071726 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 1 14:52:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:52:04.083639 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-e7e5f7b3-b5d9-478e-96ae-0bb613ac6198 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:52:04.109046 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-e7e5f7b3-b5d9-478e-96ae-0bb613ac6198 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028992 Sep 01 14:52:04.109875 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Sep 1 14:52:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:52:06.470332 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-22b99acc-4cc3-40f7-9584-939301937bea admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:06.471363 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-22b99acc-4cc3-40f7-9584-939301937bea admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 01 14:52:06.471933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:06.931357 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-8ce3a922-9a37-4c8b-8086-27e1557c0feb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "id": "5", "swap": 0, "vcpus": 8}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:52:06.953610 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-8ce3a922-9a37-4c8b-8086-27e1557c0feb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.475768 Sep 01 14:52:06.954288 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 1 14:52:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:52:06.966571 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-25e52831-a44f-4be3-9ff5-9ff52349b44d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:52:06.975488 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG dbcounter [-] [105352] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:52:06.996715 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-25e52831-a44f-4be3-9ff5-9ff52349b44d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034083 Sep 01 14:52:06.997388 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Sep 1 14:52:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:52:25.930984 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-8ce3a922-9a37-4c8b-8086-27e1557c0feb admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:25.931996 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-8ce3a922-9a37-4c8b-8086-27e1557c0feb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 01 14:52:25.932402 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:26.314952 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-0045c42e-3918-4d3e-967e-2d441fb49b4b admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:26.334174 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-0045c42e-3918-4d3e-967e-2d441fb49b4b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395294 Sep 01 14:52:26.334711 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Sep 1 14:52:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:52:27.375333 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-8ce3a922-9a37-4c8b-8086-27e1557c0feb admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:27.376336 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-8ce3a922-9a37-4c8b-8086-27e1557c0feb admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 01 14:52:27.376730 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:27.890907 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-4d13a5d0-b8b6-4da3-a912-16b33ce05789 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:27.896404 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.wsgi [None req-4d13a5d0-b8b6-4da3-a912-16b33ce05789 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-4d13a5d0-b8b6-4da3-a912-16b33ce05789 admin admin] Request method failure captured: Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Accept: application/json Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Accept-Encoding: gzip, deflate Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Connection: keep-alive Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Content-Length: 0 Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Host: 10.222.0.33 Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Openstack-Api-Version: compute 2.90 Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Openstack-System-Scope: None Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: User-Agent: python-novaclient Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Auth-Token: gAAAAABjEMcrFRzGu7zcqjJEWRwWV2TvC6ZmNxYo5yKpq_L8U139C92nFDjjdBTypM-45paAxM3gYQ69UioDU6ZP3utAuWg7o1ndHXG9Jj5wKaFnWdT-UYA6_v1hGM0YAuDSd0tpo0LVxNe0MwLtjFuq0XUw4AYh3iKSh33UaHbO9L-svoMTBoY Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Domain-Id: None Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Domain-Name: None Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Identity-Status: Confirmed Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Is-Admin-Project: True Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Domain-Id: default Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Domain-Name: Default Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Name: admin Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Role: admin,member,reader Sep 01 14:52:27.899644 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Roles: admin,member,reader Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cec9ba4a51d40d1be462a47013baf0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Tenant: admin Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Tenant-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Tenant-Name: admin Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User: admin Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Domain-Id: default Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Domain-Name: Default Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Id: abbabc07754b486599ec507190d24c97 Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Name: admin Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: method: > Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: exception: Flavor 42 could not be found. Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: action_args: {'id': '42'} Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:52:27.901207 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:27.902367 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:27.903800 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-4d13a5d0-b8b6-4da3-a912-16b33ce05789 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:52:27.905068 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-4d13a5d0-b8b6-4da3-a912-16b33ce05789 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387835 Sep 01 14:52:27.905068 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Sep 1 14:52:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 14:52:27.910912 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-15d457f7-dbfa-4041-86a3-7f4484b4a09f admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:27.915097 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:52:27.937257 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-15d457f7-dbfa-4041-86a3-7f4484b4a09f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030094 Sep 01 14:52:27.937784 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 1 14:52:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:52:27.947845 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-f658ba26-79cf-40c3-90a1-c04bca6c6984 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:27.970220 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-f658ba26-79cf-40c3-90a1-c04bca6c6984 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025926 Sep 01 14:52:27.970757 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 1 14:52:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:52:27.980698 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-62c84f9f-3fe8-43c6-99b2-b051248c3a38 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:27.987818 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.wsgi [None req-62c84f9f-3fe8-43c6-99b2-b051248c3a38 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-62c84f9f-3fe8-43c6-99b2-b051248c3a38 admin admin] Request method failure captured: Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Accept: application/json Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Accept-Encoding: gzip, deflate Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Connection: keep-alive Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Content-Length: 0 Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Host: 10.222.0.33 Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Openstack-Api-Version: compute 2.90 Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Openstack-System-Scope: None Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: User-Agent: python-novaclient Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Auth-Token: gAAAAABjEMcrFRzGu7zcqjJEWRwWV2TvC6ZmNxYo5yKpq_L8U139C92nFDjjdBTypM-45paAxM3gYQ69UioDU6ZP3utAuWg7o1ndHXG9Jj5wKaFnWdT-UYA6_v1hGM0YAuDSd0tpo0LVxNe0MwLtjFuq0XUw4AYh3iKSh33UaHbO9L-svoMTBoY Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Domain-Id: None Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Domain-Name: None Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Identity-Status: Confirmed Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Is-Admin-Project: True Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Domain-Id: default Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Domain-Name: Default Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Name: admin Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Role: admin,member,reader Sep 01 14:52:27.991040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Roles: admin,member,reader Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cec9ba4a51d40d1be462a47013baf0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Tenant: admin Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Tenant-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Tenant-Name: admin Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User: admin Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Domain-Id: default Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Domain-Name: Default Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Id: abbabc07754b486599ec507190d24c97 Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Name: admin Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: method: > Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: exception: Flavor 42 could not be found. Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: action_args: {'id': '42'} Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:52:27.992437 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:27.993259 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:27.994397 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-62c84f9f-3fe8-43c6-99b2-b051248c3a38 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:52:27.995445 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-62c84f9f-3fe8-43c6-99b2-b051248c3a38 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016124 Sep 01 14:52:27.995445 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Sep 1 14:52:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 14:52:28.943868 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-f658ba26-79cf-40c3-90a1-c04bca6c6984 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:28.944915 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-f658ba26-79cf-40c3-90a1-c04bca6c6984 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 01 14:52:28.945335 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:29.463151 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-ca7fd514-1f45-461c-aa9e-5e2e0c265c46 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:29.468960 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.wsgi [None req-ca7fd514-1f45-461c-aa9e-5e2e0c265c46 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-ca7fd514-1f45-461c-aa9e-5e2e0c265c46 admin admin] Request method failure captured: Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Accept: application/json Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Accept-Encoding: gzip, deflate Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Connection: keep-alive Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Content-Length: 0 Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Host: 10.222.0.33 Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Openstack-Api-Version: compute 2.90 Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Openstack-System-Scope: None Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: User-Agent: python-novaclient Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Auth-Token: gAAAAABjEMcsvgDzqx8WCRoldsfAzluS0e22Ryzz8lHwOEQvHjgOtUSQIHkjV822kwY9Jbpo1E0IpigYW7rHKq4Xv32-uWKWOT5TixrDkf_15oLeYdNVE5lVwM56GLKn7A3gzAa48WFWRRRSFoKRr9NnVLcV4lIOnfGUegj5noEsPeYLnBk5rX8 Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Domain-Id: None Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Domain-Name: None Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Identity-Status: Confirmed Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Is-Admin-Project: True Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Domain-Id: default Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Domain-Name: Default Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Name: admin Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Role: admin,member,reader Sep 01 14:52:29.470490 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Roles: admin,member,reader Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cec9ba4a51d40d1be462a47013baf0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Tenant: admin Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Tenant-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Tenant-Name: admin Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User: admin Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Domain-Id: default Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Domain-Name: Default Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Id: abbabc07754b486599ec507190d24c97 Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Name: admin Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: method: > Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: exception: Flavor 84 could not be found. Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: action_args: {'id': '84'} Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:52:29.472040 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:29.473007 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:29.474363 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-ca7fd514-1f45-461c-aa9e-5e2e0c265c46 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:52:29.475645 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-ca7fd514-1f45-461c-aa9e-5e2e0c265c46 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.387679 Sep 01 14:52:29.475645 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Sep 1 14:52:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 14:52:29.481452 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-39a36231-5835-4302-b211-bae4faac544c admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:29.497196 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-39a36231-5835-4302-b211-bae4faac544c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019315 Sep 01 14:52:29.497657 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 1 14:52:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:52:29.506827 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-a934782d-dd6b-44c1-ba09-feb28b1a5b4f admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:29.521309 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-a934782d-dd6b-44c1-ba09-feb28b1a5b4f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017944 Sep 01 14:52:29.521811 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 1 14:52:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:52:29.531215 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-38f35823-f1bd-42d7-b8e1-1376e0054694 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:29.536318 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.wsgi [None req-38f35823-f1bd-42d7-b8e1-1376e0054694 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-38f35823-f1bd-42d7-b8e1-1376e0054694 admin admin] Request method failure captured: Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Accept: application/json Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Accept-Encoding: gzip, deflate Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Connection: keep-alive Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Content-Length: 0 Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Host: 10.222.0.33 Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Openstack-Api-Version: compute 2.90 Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Openstack-System-Scope: None Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: User-Agent: python-novaclient Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Auth-Token: gAAAAABjEMcsvgDzqx8WCRoldsfAzluS0e22Ryzz8lHwOEQvHjgOtUSQIHkjV822kwY9Jbpo1E0IpigYW7rHKq4Xv32-uWKWOT5TixrDkf_15oLeYdNVE5lVwM56GLKn7A3gzAa48WFWRRRSFoKRr9NnVLcV4lIOnfGUegj5noEsPeYLnBk5rX8 Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Domain-Id: None Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Domain-Name: None Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Identity-Status: Confirmed Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Is-Admin-Project: True Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Domain-Id: default Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Domain-Name: Default Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Name: admin Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Role: admin,member,reader Sep 01 14:52:29.537798 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Roles: admin,member,reader Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cec9ba4a51d40d1be462a47013baf0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Tenant: admin Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Tenant-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Tenant-Name: admin Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User: admin Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Domain-Id: default Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Domain-Name: Default Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Id: abbabc07754b486599ec507190d24c97 Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Name: admin Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: method: > Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: exception: Flavor 84 could not be found. Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: action_args: {'id': '84'} Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:52:29.539607 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:29.540739 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:29.542160 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-38f35823-f1bd-42d7-b8e1-1376e0054694 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:52:29.543518 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-38f35823-f1bd-42d7-b8e1-1376e0054694 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012018 Sep 01 14:52:29.543518 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Sep 1 14:52:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 14:52:30.492303 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-a934782d-dd6b-44c1-ba09-feb28b1a5b4f admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:30.493302 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-a934782d-dd6b-44c1-ba09-feb28b1a5b4f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 01 14:52:30.493692 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:31.008176 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-68ec9b61-f917-4951-b6f8-1bedd3786e16 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:31.013868 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.wsgi [None req-68ec9b61-f917-4951-b6f8-1bedd3786e16 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-68ec9b61-f917-4951-b6f8-1bedd3786e16 admin admin] Request method failure captured: Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Accept: application/json Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Accept-Encoding: gzip, deflate Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Connection: keep-alive Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Content-Length: 0 Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Host: 10.222.0.33 Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Openstack-Api-Version: compute 2.90 Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Openstack-System-Scope: None Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: User-Agent: python-novaclient Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Auth-Token: gAAAAABjEMcuincNOtl1gKUanHp5l2AQqYKX9SoQvAXwXmojPESfJCe5Wlbx-Wmr4Eno60Kf9Iroh4aMUZX8ZKvXqvFDRhQWxVz-D94PawyFFGxaQJoiZboLJQ04KUNx_7qkx-eubCLFxTaB0LMRcSXLdkNpvvdyA6EC5T3qe2zRnWj2_VUjGXU Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Domain-Id: None Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Domain-Name: None Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Identity-Status: Confirmed Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Is-Admin-Project: True Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Domain-Id: default Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Domain-Name: Default Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Project-Name: admin Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Role: admin,member,reader Sep 01 14:52:31.015391 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Roles: admin,member,reader Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cec9ba4a51d40d1be462a47013baf0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Tenant: admin Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Tenant-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-Tenant-Name: admin Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User: admin Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Domain-Id: default Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Domain-Name: Default Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Id: abbabc07754b486599ec507190d24c97 Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: X-User-Name: admin Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: method: > Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: exception: Flavor 451 could not be found. Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: action_args: {'id': '451'} Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:52:31.016933 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:31.017881 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: ERROR nova.api.openstack.wsgi Sep 01 14:52:31.019043 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-68ec9b61-f917-4951-b6f8-1bedd3786e16 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105352) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:52:31.020107 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-68ec9b61-f917-4951-b6f8-1bedd3786e16 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.385723 Sep 01 14:52:31.020107 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 1 14:52:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 14:52:31.026423 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-20f89cfa-93c1-451e-90a0-f23068fff78e admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:31.041738 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-20f89cfa-93c1-451e-90a0-f23068fff78e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018887 Sep 01 14:52:31.042260 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 1 14:52:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:52:31.052447 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:31.068169 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019480 Sep 01 14:52:31.068681 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 1 14:52:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:52:31.077816 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-c5e6ad74-201a-42df-995e-f9e130e93f2e admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:31.083116 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.wsgi [None req-c5e6ad74-201a-42df-995e-f9e130e93f2e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-c5e6ad74-201a-42df-995e-f9e130e93f2e admin admin] Request method failure captured: Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Accept: application/json Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Accept-Encoding: gzip, deflate Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Connection: keep-alive Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Content-Length: 0 Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Host: 10.222.0.33 Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Openstack-Api-Version: compute 2.90 Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Openstack-System-Scope: None Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: User-Agent: python-novaclient Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Auth-Token: gAAAAABjEMcuincNOtl1gKUanHp5l2AQqYKX9SoQvAXwXmojPESfJCe5Wlbx-Wmr4Eno60Kf9Iroh4aMUZX8ZKvXqvFDRhQWxVz-D94PawyFFGxaQJoiZboLJQ04KUNx_7qkx-eubCLFxTaB0LMRcSXLdkNpvvdyA6EC5T3qe2zRnWj2_VUjGXU Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Domain-Id: None Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Domain-Name: None Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Identity-Status: Confirmed Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Is-Admin-Project: True Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Domain-Id: default Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Domain-Name: Default Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Project-Name: admin Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Role: admin,member,reader Sep 01 14:52:31.084593 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Roles: admin,member,reader Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cec9ba4a51d40d1be462a47013baf0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cec9ba4a51d40d1be462a47013baf0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Tenant: admin Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Tenant-Id: 5cec9ba4a51d40d1be462a47013baf0a Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-Tenant-Name: admin Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User: admin Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Domain-Id: default Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Domain-Name: Default Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Id: abbabc07754b486599ec507190d24c97 Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: X-User-Name: admin Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: method: > Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: exception: Flavor 451 could not be found. Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: action_args: {'id': '451'} Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:52:31.086131 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:31.087125 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Sep 01 14:52:31.088392 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-c5e6ad74-201a-42df-995e-f9e130e93f2e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:52:31.089650 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-c5e6ad74-201a-42df-995e-f9e130e93f2e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011632 Sep 01 14:52:31.089650 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 1 14:52:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 14:52:32.044259 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:32.045328 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 01 14:52:32.045719 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:52:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:32.559650 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-631424cb-5bed-46f8-9855-1f15306bec2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:52:32.578034 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-631424cb-5bed-46f8-9855-1f15306bec2d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.394498 Sep 01 14:52:32.578612 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Sep 1 14:52:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:52:33.538573 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:33.539660 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Sep 01 14:52:33.539999 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:52:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:34.055778 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-401840f5-ab20-4e6b-9690-9d95305a6c30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:52:34.075223 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-401840f5-ab20-4e6b-9690-9d95305a6c30 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.396618 Sep 01 14:52:34.076339 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Sep 1 14:52:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:52:35.028109 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:35.029643 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 Sep 01 14:52:35.030040 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:52:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:35.553948 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-2e6b398f-973a-4698-b3f9-55f451bd88ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:52:35.573011 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-2e6b398f-973a-4698-b3f9-55f451bd88ba admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.398895 Sep 01 14:52:35.573543 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Sep 1 14:52:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:52:36.541338 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:36.542327 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 01 14:52:36.542720 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:37.067041 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-f4c9d1d0-b263-45a4-adbd-36d0c6384d1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:52:37.085872 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-f4c9d1d0-b263-45a4-adbd-36d0c6384d1a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.398511 Sep 01 14:52:37.086473 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Sep 1 14:52:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:52:38.041331 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:38.042387 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 01 14:52:38.042785 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:52:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:52:38.560768 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-509f09f0-e8c3-4ae7-af49-799eaa592634 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:52:38.581947 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-509f09f0-e8c3-4ae7-af49-799eaa592634 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401985 Sep 01 14:52:38.582503 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Thu Sep 1 14:52:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:53:30.875297 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:53:30.876308 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-692ddc6b-4226-4940-a403-957b272e00d5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 01 14:53:30.876699 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 1 14:53:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:53:30.887284 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:53:31.259925 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-e8089826-7edc-4465-8c22-73591c6979be admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:53:31.280690 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-e8089826-7edc-4465-8c22-73591c6979be admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398045 Sep 01 14:53:31.281222 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Sep 1 14:53:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:53:31.302750 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG dbcounter [-] [105352] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:53:31.306700 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-04dc8e70-983a-42f3-af91-a0656d86555e admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:53:31.315243 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-04dc8e70-983a-42f3-af91-a0656d86555e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013942 Sep 01 14:53:31.315758 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1283 bytes} [Thu Sep 1 14:53:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:53:31.327262 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-3df197ad-93cc-4e48-abb6-fe5fe49df6bf admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:53:31.334832 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-3df197ad-93cc-4e48-abb6-fe5fe49df6bf admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011152 Sep 01 14:53:31.335341 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1286 bytes} [Thu Sep 1 14:53:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:53:31.347134 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-b9bc28dd-9bb3-4b73-8354-60bfb1ece51b admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:53:31.355465 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-b9bc28dd-9bb3-4b73-8354-60bfb1ece51b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012106 Sep 01 14:53:31.355976 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1286 bytes} [Thu Sep 1 14:53:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:53:31.367144 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-79cfcef1-bc79-4117-b0db-cc1a653cb537 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:53:31.374710 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-79cfcef1-bc79-4117-b0db-cc1a653cb537 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010962 Sep 01 14:53:31.375214 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1283 bytes} [Thu Sep 1 14:53:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:56:27.700533 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-b9bc28dd-9bb3-4b73-8354-60bfb1ece51b admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:56:27.701563 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-b9bc28dd-9bb3-4b73-8354-60bfb1ece51b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 01 14:56:27.701955 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:56:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:56:27.842607 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_api:SELECT=6 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:56:27.998688 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-8edb6981-7846-4a61-a78d-acd993a30945 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:56:28.002278 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-8edb6981-7846-4a61-a78d-acd993a30945 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:56:28.002760 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-8edb6981-7846-4a61-a78d-acd993a30945 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:56:28.003190 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-8edb6981-7846-4a61-a78d-acd993a30945 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:56:28.003946 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-8edb6981-7846-4a61-a78d-acd993a30945 admin admin] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:56:28.004413 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-8edb6981-7846-4a61-a78d-acd993a30945 admin admin] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:56:28.004855 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-8edb6981-7846-4a61-a78d-acd993a30945 admin admin] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:56:28.038995 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-8edb6981-7846-4a61-a78d-acd993a30945 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.197919 Sep 01 14:56:28.039549 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 1 14:56:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:56:28.859708 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-b9bc28dd-9bb3-4b73-8354-60bfb1ece51b admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:56:28.860710 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-b9bc28dd-9bb3-4b73-8354-60bfb1ece51b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 01 14:56:28.861106 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:56:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:56:29.049924 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-fe888f16-723d-4d20-8939-987f7543e1ac admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:56:29.053295 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-fe888f16-723d-4d20-8939-987f7543e1ac admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:56:29.053770 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-fe888f16-723d-4d20-8939-987f7543e1ac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:56:29.054205 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-fe888f16-723d-4d20-8939-987f7543e1ac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:56:29.054943 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-fe888f16-723d-4d20-8939-987f7543e1ac admin admin] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:56:29.055390 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-fe888f16-723d-4d20-8939-987f7543e1ac admin admin] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:56:29.055803 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-fe888f16-723d-4d20-8939-987f7543e1ac admin admin] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:56:29.075050 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-fe888f16-723d-4d20-8939-987f7543e1ac admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076135 Sep 01 14:56:29.075586 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 1 14:56:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:56:40.308255 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-b9bc28dd-9bb3-4b73-8354-60bfb1ece51b admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:56:40.309256 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-b9bc28dd-9bb3-4b73-8354-60bfb1ece51b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 Sep 01 14:56:40.309650 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:56:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:56:40.454180 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_cell0:SELECT=4 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:56:40.454911 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_cell1:SELECT=4 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:56:40.455509 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_api:SELECT=8 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:56:40.504351 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-2fb59819-c57b-4136-bce1-c2cf062f6c05 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:56:40.507710 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-2fb59819-c57b-4136-bce1-c2cf062f6c05 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:56:40.508209 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-2fb59819-c57b-4136-bce1-c2cf062f6c05 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:56:40.508631 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-2fb59819-c57b-4136-bce1-c2cf062f6c05 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:56:40.509358 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-2fb59819-c57b-4136-bce1-c2cf062f6c05 admin admin] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:56:40.509796 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-2fb59819-c57b-4136-bce1-c2cf062f6c05 admin admin] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:56:40.510213 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-2fb59819-c57b-4136-bce1-c2cf062f6c05 admin admin] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:56:40.534873 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-2fb59819-c57b-4136-bce1-c2cf062f6c05 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085018 Sep 01 14:56:40.535339 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 37/74] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 1 14:56:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:56:41.358087 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: DEBUG nova.api.openstack.wsgi [None req-b9bc28dd-9bb3-4b73-8354-60bfb1ece51b admin admin] Calling method '>' {{(pid=105352) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:56:41.359118 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: INFO nova.api.openstack.requestlog [None req-b9bc28dd-9bb3-4b73-8354-60bfb1ece51b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 01 14:56:41.359505 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: [pid: 105352|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 1 14:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:56:41.546049 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-de27e207-24f7-4bbe-9694-ee1a910d5b01 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:56:41.549454 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-de27e207-24f7-4bbe-9694-ee1a910d5b01 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:56:41.549864 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-de27e207-24f7-4bbe-9694-ee1a910d5b01 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:56:41.550309 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-de27e207-24f7-4bbe-9694-ee1a910d5b01 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:56:41.551016 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-de27e207-24f7-4bbe-9694-ee1a910d5b01 admin admin] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:56:41.551454 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-de27e207-24f7-4bbe-9694-ee1a910d5b01 admin admin] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:56:41.551864 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-de27e207-24f7-4bbe-9694-ee1a910d5b01 admin admin] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:56:41.574498 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-de27e207-24f7-4bbe-9694-ee1a910d5b01 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078571 Sep 01 14:56:41.575022 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 38/76] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 1 14:56:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:57:38.087723 dv-cinder-855058-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 14:57:38.088443 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: Thu Sep 1 14:57:38 2022 - graceful shutdown triggered... Sep 01 14:57:38.088930 dv-cinder-855058-2-iscsi devstack@n-api.service[105351]: Gracefully killing worker 1 (pid: 105351)... Sep 01 14:57:38.089313 dv-cinder-855058-2-iscsi devstack@n-api.service[105352]: Gracefully killing worker 2 (pid: 105352)... Sep 01 14:57:39.089637 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: worker 1 buried after 1 seconds Sep 01 14:57:39.089637 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: worker 2 buried after 1 seconds Sep 01 14:57:39.089637 dv-cinder-855058-2-iscsi devstack@n-api.service[105350]: goodbye to uWSGI. Sep 01 14:57:39.091285 dv-cinder-855058-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 14:57:39.091832 dv-cinder-855058-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 14:57:39.094778 dv-cinder-855058-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 14:57:39.106048 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 14:57:39 2022] *** Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: nodename: dv-cinder-855058-2-iscsi Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: machine: x86_64 Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: clock source: unix Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: pcre jit disabled Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: detected number of CPU cores: 4 Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: current working directory: / Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: detected binary path: /usr/bin/uwsgi-core Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: your processes number limit is 47680 Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: your memory page size is 4096 bytes Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: detected max file descriptor number: 2048 Sep 01 14:57:39.108346 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: lock engine: pthread robust mutexes Sep 01 14:57:39.109336 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: thunder lock: enabled Sep 01 14:57:39.109336 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 14:57:39.109336 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 14:57:39.148383 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: Python main interpreter initialized at 0x55a336edb9c0 Sep 01 14:57:39.148383 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: python threads support enabled Sep 01 14:57:39.148383 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: your server socket listen backlog is limited to 100 connections Sep 01 14:57:39.148383 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: your mercy for graceful operations on workers is 90 seconds Sep 01 14:57:39.148846 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 14:57:39.148846 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: *** Operational MODE: preforking *** Sep 01 14:57:39.149096 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: *** uWSGI is running in multiple interpreter mode *** Sep 01 14:57:39.149096 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: spawned uWSGI master process (pid: 120540) Sep 01 14:57:39.154496 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: spawned uWSGI worker 1 (pid: 120553, cores: 1) Sep 01 14:57:39.154496 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: spawned uWSGI worker 2 (pid: 120554, cores: 1) Sep 01 14:57:39.154496 dv-cinder-855058-2-iscsi devstack@n-api.service[120540]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 14:57:39.149299 dv-cinder-855058-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 14:57:39.809010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 14:57:39.826388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 14:57:40.952032 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:57:40.952032 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: from cryptography.utils import int_from_bytes Sep 01 14:57:40.952662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:57:40.952662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: from cryptography.utils import int_from_bytes Sep 01 14:57:40.985859 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:57:40.985859 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: from cryptography.utils import int_from_bytes Sep 01 14:57:40.986480 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:57:40.986480 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: from cryptography.utils import int_from_bytes Sep 01 14:57:43.363860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 14:57:43.364470 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 14:57:43.364765 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 14:57:43.365032 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 14:57:43.365295 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 14:57:43.365685 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.366014 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.366409 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.366735 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.367071 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.367387 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.367722 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.368046 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.368377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.368648 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.368968 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.369296 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855058-2-iscsi {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.369801 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.370118 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.370465 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.370791 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.371101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.371431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.371743 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.372258 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.373749 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.373749 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.373749 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.373749 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.374110 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.374394 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.374599 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.374884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.375207 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.376322 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.376322 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855058-2-iscsi {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.376322 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.376551 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.376834 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.377266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.377592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.377913 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.378259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.378582 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.378892 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.379241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.379558 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.379880 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.380214 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.380522 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.380829 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.381132 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.381453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.381801 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.382116 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.382400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.382714 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.383040 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.383364 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.383693 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.383975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.384204 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.384527 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.384852 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.385165 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.385475 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.385783 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.386089 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.386425 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.386737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.387048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.387357 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.387692 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.388092 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.388325 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.388631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.388958 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.389369 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.389634 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.389942 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.390311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.390637 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.390951 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.391274 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.391599 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.391909 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.392219 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.392526 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.392845 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.393186 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.393495 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.393751 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.394058 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.394459 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.394780 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.395088 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.395397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.395704 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.396007 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.396316 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.396624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.396932 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.397240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.398094 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.398441 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.398752 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.399066 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.399376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.399682 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.400010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.400330 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.400643 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.400954 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.401260 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.401565 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.401885 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.402193 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.402527 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.402852 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.403159 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.403461 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.403780 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.404087 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.404392 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.404712 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.405015 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.405322 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.405639 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.405953 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.406268 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.406575 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.406881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.407183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.407488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.407790 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.408103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.408405 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.408721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.409042 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.409355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.409661 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.409985 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.410306 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.410646 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.410980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.411323 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.411644 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.411977 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.412310 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.412630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.412630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.412630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.414381 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.414465 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.414761 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.415076 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.415397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.415718 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.416050 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.416369 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.416685 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.417006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.417317 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.417635 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.417970 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.418319 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.418635 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.418977 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.419113 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 14:57:43.419561 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.419649 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 14:57:43.419738 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.419910 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 14:57:43.420055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.420248 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.420404 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 14:57:43.420510 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 14:57:43.420586 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.420856 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.421019 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.421167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.421316 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.421506 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.421662 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.421831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.421968 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.422100 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.422184 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.422447 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.422593 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.422746 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.422896 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.423072 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.423219 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.423439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.423552 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.423697 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.423797 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.424057 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.424163 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.424322 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.424424 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855058-2-iscsi {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.424635 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.424793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.424977 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.425294 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.425452 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.425618 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.425780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.425936 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.426115 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.426263 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.426461 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.426589 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.426799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.426891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.427119 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.427212 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.427495 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.427640 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.427802 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.427965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.428116 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.428284 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.428424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.428627 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.428764 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.428980 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.429078 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.429307 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.429407 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.429628 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.429727 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.429960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.430053 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.430302 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.430411 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.430904 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.431010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.431216 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.431307 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.431529 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.431649 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855058-2-iscsi {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.431842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.431934 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.432153 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.432254 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.432470 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.432561 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.432782 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.432972 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.433089 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.433297 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.433455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.433619 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.433720 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.433953 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.434054 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.434325 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.434435 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.434633 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.434737 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.434941 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.435055 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.435258 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.435364 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.435572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.435673 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.435884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.435989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.436198 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.436300 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.436509 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.436601 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.436823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.436921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.437132 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.437230 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.437440 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.437533 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.437754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.437852 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.438015 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.438114 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.438360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.438469 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.438696 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.438789 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.439030 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.439129 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.439345 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.439444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.439608 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.439708 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.439869 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.439969 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.440197 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.440306 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.440529 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.440626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.440836 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.440924 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.441147 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.441250 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.441450 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.441542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.441753 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.441853 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.442058 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.442151 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.442389 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.442496 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.442696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.442799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.443015 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.443108 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.443321 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.443412 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.443625 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.443717 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.443930 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.444031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.444254 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.444357 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.444602 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.444694 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.444909 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.445010 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.445252 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.445350 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.445574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.445674 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.445891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.445991 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.446216 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.446339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.446557 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.446657 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.446874 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.446976 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.447186 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.447285 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.447500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.447609 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.447812 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.447906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.448126 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.448218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.449056 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.449162 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.449255 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.449336 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.449416 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.449488 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.449488 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.449617 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.449701 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.449784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.449920 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.450002 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.450272 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.450380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.450589 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.450682 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.450904 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.450996 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.451220 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.451302 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.451577 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.451681 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.451906 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.452980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.452980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.453152 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.453249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.453391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.453523 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.453654 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.453790 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.453930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.454061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.454200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.455337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.455512 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.455663 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.455836 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.455992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.456147 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.456304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.456448 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.456592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.456592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.456885 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.457036 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.457180 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.457330 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.457487 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.457642 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.457785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.457928 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.458084 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.458227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.458463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.458618 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.458769 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.458769 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.459063 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.459207 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.459357 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.459357 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.459657 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.459657 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.460561 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.460807 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.460958 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.461102 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.461252 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.461410 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.461556 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.461793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.461961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.461961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.462365 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.462541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.462686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.462835 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.462979 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.463128 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.463284 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.463420 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.463544 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.463657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.463831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.463957 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.464066 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.464192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.464328 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.464458 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.464548 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.464634 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.464779 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.465060 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.465185 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.465271 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.465393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.465582 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.465743 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.465839 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.465973 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.466066 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.466277 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.466446 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.466527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.466667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.466807 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.466927 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.467064 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.467208 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.467208 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.467470 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:57:43.467613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.467704 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.467790 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.467888 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.467975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.468059 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.468143 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.468232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.468370 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.468523 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.468624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.468778 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.468881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.469021 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.469168 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.469286 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.469421 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.469563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.469660 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.469660 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.469825 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.469912 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.470003 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.470089 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.470178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.470366 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.470471 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.470698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.470819 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.470916 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.471013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.471100 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.471255 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.471389 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.471537 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.471711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.471827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.472017 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.472131 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.472329 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.472434 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.472639 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.472773 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.472945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.473060 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.473256 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.473396 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.473572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.473709 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.474062 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.474206 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.474443 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.474542 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.474769 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.474872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.475107 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.475208 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.475441 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.475590 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.476308 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.476416 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.476632 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.476725 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.476954 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.477061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.477306 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.477399 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.477613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.477711 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.477925 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.478030 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.478276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.478386 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.478569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.478661 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.478881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.478974 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.479188 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.479334 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.479494 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.479596 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.479799 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.479900 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.480110 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.480202 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.480414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.480506 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.480720 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.480848 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.481024 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.481136 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.481330 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.481496 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.481641 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.482461 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.482675 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.482848 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.483002 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.483156 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.483308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.483482 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.483716 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.483874 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.484030 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.484183 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.484333 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.484484 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.484636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.484779 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.484929 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.485085 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.485228 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.485371 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.485521 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.485673 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.485816 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.485977 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.486120 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.486281 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.486431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.486574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.486730 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.486882 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.487025 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.487173 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.487316 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.487458 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.487609 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.487763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.487915 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.488066 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.488208 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.488349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.488500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.488598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.488685 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.488769 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.488854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.489012 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.489120 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.489208 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.489293 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.489432 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.489522 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.489604 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.489678 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.489825 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.489923 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.490009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.490100 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.490341 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.490462 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.490666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.490779 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.490971 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.491072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.491302 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.491395 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.491606 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.491698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.491921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.492073 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.492654 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.492760 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.492919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.493074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.493152 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.493236 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.493330 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.493412 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.493493 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.493584 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.493855 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.494025 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.494172 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.494353 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.494484 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.494598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.494687 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.494785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.494917 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.495076 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.495223 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.495396 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.495546 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.495710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.495857 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.496027 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.496163 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.496341 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.496482 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.496664 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.496787 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.497047 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.497151 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.497249 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.497349 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.497555 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.497649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.497870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.497967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.498384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.498588 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.498712 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.498860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.498997 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.499093 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.499176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.499269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.499431 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.499531 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.499731 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.499826 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.500044 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.500172 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.500349 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.500473 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.500654 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.500816 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.500980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.501131 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.501280 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.501423 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.501570 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.501710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.501860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.502007 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.502154 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.502363 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.502474 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.502610 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.502758 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.502912 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.503031 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.503233 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.503377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.503558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.503682 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.503928 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.504035 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.504200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.504328 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.504529 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.504631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.504851 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.504951 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.505187 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.505287 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.505511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.505607 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.505833 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.505932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.506132 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.506267 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.506472 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.506579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.506808 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.506906 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.507125 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.507228 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.507430 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.507522 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.507737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.507831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.508061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.508168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.508373 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.508466 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.508690 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.508823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.509011 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.509158 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.509330 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.509431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.509649 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.509743 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.509953 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.510057 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.510283 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.510381 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.510598 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.510702 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.510909 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.511006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.511220 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.511316 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.511531 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.511624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.511843 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.511944 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.512155 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.512247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.512460 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.512558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.512770 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.512872 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.513080 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.513227 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.513390 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.513527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.513703 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.513831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.514018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.514149 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.514355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.514492 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.514681 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.514794 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.514999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.515114 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.515311 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.515416 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.515618 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.515722 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.515928 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.516036 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.516240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.516352 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.516547 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.516648 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.516861 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.516978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.517176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.517286 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.517497 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.517591 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.517816 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.517910 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.518129 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.518224 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.518468 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.518573 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.518817 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.518972 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.519124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.519245 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.519403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.519505 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.519734 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.519871 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.520126 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.520441 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.520783 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.521126 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.521444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.521784 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.522111 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.522968 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.523089 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.523290 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.523390 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.523614 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.523734 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.523971 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.524082 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.524427 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.524639 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.524751 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.524977 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.525085 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.525340 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.525450 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.525670 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.525779 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.525994 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.526092 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.526338 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.526450 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.526662 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.526775 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.526997 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.527539 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.527665 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.527751 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.527863 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.528138 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.528226 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.528226 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.528370 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.528547 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.528689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.528866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.528971 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.529199 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.529307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.529518 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.529623 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.529838 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.529958 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.530158 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.530300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.530511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.530619 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.530833 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.530926 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.531158 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.531258 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.531578 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.531743 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.531900 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.532088 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.532223 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.532416 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.532537 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.532745 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.532868 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.533109 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.533202 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.533443 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.533540 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.533784 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.533878 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.534121 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.534342 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.534453 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.534701 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.534811 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.535046 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.535160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.535373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.535480 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.535687 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.535794 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.535997 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.536110 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.536306 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.536405 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.536621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.536717 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.536931 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.537044 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.537241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.537346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.537549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.537656 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.537860 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.537978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.538780 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.538880 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.539210 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.539341 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.539429 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.539506 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.539839 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.539949 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.540026 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.540106 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.540382 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.540485 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.540662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.540763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.540941 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.541035 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.541302 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.541411 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.541567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.541717 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.541881 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.541977 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.542259 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.542368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.542568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.542670 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.542890 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.542997 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.543200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.543306 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.543512 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.543612 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.543821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.543972 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.544167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.544261 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.544512 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.544648 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.544814 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.544921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.545127 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.545221 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.545441 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.545536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.545763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.545857 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.546080 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.546185 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.546416 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.546513 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.546736 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.546883 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.547053 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.547155 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.547369 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.547469 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.547687 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.547782 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.547991 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.548082 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.548304 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.548403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.548608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.548700 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.548917 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.549017 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.549225 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.549315 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.549533 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.549780 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.549870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.550094 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.550435 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.553212 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.553473 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.553664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.553829 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.553991 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.554151 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.554355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.554512 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.554663 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.554815 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.554965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.554965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.555273 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.555431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.555847 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.556008 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.556166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.556325 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.556484 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.556641 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.556791 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.556949 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.557099 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.557259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.557417 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.557574 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.557724 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.557891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.558043 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.558201 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.558391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.558543 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.558710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.558861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.559011 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.559175 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.559333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.559333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.559633 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.559794 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.559953 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.560111 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.560268 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.560417 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.560574 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.560737 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.560900 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.561058 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.561058 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.561344 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.561494 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.561652 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.561812 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.561962 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.562111 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.562294 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.562463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.562623 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.562780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.562936 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.563096 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.563254 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.563413 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.563571 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.563729 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.563909 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.564068 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.564226 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.564386 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.564543 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.564693 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.564850 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.565000 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.565163 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.565315 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.565501 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.565661 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.565824 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.565980 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.566139 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.566378 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.566612 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.566768 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.566918 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.567079 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.567238 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.567397 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.567547 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.567724 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.567894 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.568058 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.568173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.568285 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.568396 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.568514 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.568627 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.568806 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.568927 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.569053 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.569165 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.569816 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.569944 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.570092 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.570224 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.570394 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.570529 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.570672 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.570672 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.570925 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.571056 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.571194 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.571332 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.571470 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.571611 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.571742 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.571864 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.571864 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.572123 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.572254 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.572254 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.572514 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.572645 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.572645 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.572907 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.573037 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.573037 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.573292 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.573435 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.573567 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.573698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.573698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.573968 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.574098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.574098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.574098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.574497 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.574637 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.574637 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.574908 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.575040 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.575281 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.575421 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.575598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.575789 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.575923 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.576219 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.576358 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.576540 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.576744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.576879 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.577215 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.577358 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.577592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.577734 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.577914 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.578166 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.578351 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.578558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.578698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.578880 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.579074 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.579208 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.579507 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.579648 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.579818 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.580000 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.580247 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.580441 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.580582 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.580875 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.581017 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.581191 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.581357 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.581492 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.581804 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.581939 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.582125 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.582309 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.582499 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.582817 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.583026 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.583162 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.583433 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.583574 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.583770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.583964 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.584104 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.584411 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.584556 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.584856 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.585590 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.585727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.585950 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.586092 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.586409 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.586548 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.586784 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.586959 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.587094 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.587323 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.587466 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.587743 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.587883 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.588080 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.588241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.588385 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.588679 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.588819 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.589039 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.589181 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.589351 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.589567 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.589709 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.589998 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.590130 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.590360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.590520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.590665 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.590915 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.591049 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.591316 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.591457 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.591641 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.591813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.591975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.592264 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.592406 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.592698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.592841 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.593026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.593214 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.593360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.593619 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.593754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.593982 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.594122 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.594341 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.594536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.594672 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.594965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.595115 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.595290 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.595450 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.595613 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.595879 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.596021 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.596240 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.596426 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.596567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.596856 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.596999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.597168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.597365 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.597502 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.597779 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.597914 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.598101 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.598262 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.598478 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.598695 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.598838 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.599123 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.599264 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.599455 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.599731 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.599872 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.600092 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.600232 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.600415 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.600683 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.600818 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.601063 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.601273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.601444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.601714 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.601854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.602033 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.602197 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.602390 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.602669 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.602882 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.603059 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.603192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.603382 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.603580 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.603721 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.604050 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.604185 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.604378 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.604537 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.604707 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.605040 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.605265 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.605398 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.605656 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.605797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.605990 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.606585 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.606759 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.606891 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.607021 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.607150 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.607281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.607426 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.607657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.607793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.608030 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.608177 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.608350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.608605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.608739 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.608985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.609143 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.609320 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.609583 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.609736 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.609943 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.610096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.610264 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.610568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.610716 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.610924 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.611079 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.611241 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.611522 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.611656 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.611881 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.612022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.612216 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.612422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.612558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.612857 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.612989 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.613183 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.613317 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.613510 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.613746 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.613934 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.614155 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.614327 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.614511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.614654 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.614833 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.615095 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.615229 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.615472 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.615605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.615800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.615987 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.616736 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.616891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.616891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.617138 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.617138 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.617397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.617535 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.617680 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.617817 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.617973 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.618200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.618429 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.618647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.618789 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.618970 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.619200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.619341 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.619595 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.619735 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.619935 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.620110 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.620269 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.620550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.620685 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.620938 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.621070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.621269 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.621475 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.621618 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.621903 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.622045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.622255 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.622607 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.622740 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.622912 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.623102 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.623246 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.623539 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.623672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.623864 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.624036 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.624192 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.624474 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.624615 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.624818 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.624985 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.625127 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.625439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.625579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.625755 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.625927 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.626061 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.627220 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.627385 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.627518 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.627648 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.627648 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.627973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.628116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.628255 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.628393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.628393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.628650 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.628782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.628782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.629028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.629157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.629288 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.629431 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.629624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.629759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.630053 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.630195 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.630424 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.630558 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.630756 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.630994 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.631136 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.631407 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.631556 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.632228 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.632418 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.632561 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.632850 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.632984 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.633164 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.633332 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.633475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.633764 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.633905 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.634099 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.634259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.634447 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.634691 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.634825 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.635081 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.635235 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.635533 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.635667 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.635960 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.636100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.636288 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.636434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.636627 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.636847 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.636980 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.637524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.637666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.637666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.637956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.638088 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.638226 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.638384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.638597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.638763 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.638897 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.639147 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.639279 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.639464 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.639664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.639806 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.640086 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.640226 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.640407 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.640548 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.640723 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.640971 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.641105 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.641342 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.641475 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.641680 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.641932 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.642075 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.642531 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.642678 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.642822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.642965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.643097 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.643226 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.643363 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.643540 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.643759 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.643903 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.644153 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.644292 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.644484 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.644678 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.644820 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.645103 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.645236 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.645418 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.645598 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.645738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.646031 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.646183 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.646438 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.646572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.646860 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.647025 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.647181 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.648370 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.648502 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.648633 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.648771 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.648771 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.649042 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.649182 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.649313 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.649443 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.649599 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.649731 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.649922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.650145 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.650355 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.650686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.651258 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.651605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.651942 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.652287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.652633 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.652949 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.653363 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.653584 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.653923 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.654262 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.654620 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.654947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.655270 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.655590 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.655912 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.656235 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.656557 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.656877 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.657128 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.657273 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.657609 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.657817 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.657951 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.658104 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.658608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.658747 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.658870 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.658989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.659108 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.659405 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.660138 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.660138 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.660376 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.660670 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.660990 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.661312 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.661631 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.661956 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.666281 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.666281 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667108 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667261 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667342 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667416 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667416 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667559 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667631 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667784 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667855 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.667945 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668026 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668106 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668180 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668258 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668332 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668411 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668493 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668638 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668709 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668794 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668874 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.668954 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669027 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669177 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669177 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669333 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669405 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669405 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669535 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669686 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669837 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669917 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.669917 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.670070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.670150 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.670223 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.670325 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.670398 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.671075 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.671252 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.671401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.671553 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.671705 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.671850 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.671993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.672145 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.672290 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.672458 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.672603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.672753 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 14:57:43.672942 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.672942 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.673239 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.673391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.673574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.673892 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.674208 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.674556 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.674874 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.675188 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.675501 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.675846 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.676193 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.676594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.676850 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.677173 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.679930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.681439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.681439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.681439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.681439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.681978 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.681978 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.682307 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.682514 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.682850 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.683178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.683509 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.683838 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.684162 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.684506 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.684829 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.685152 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.685473 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.685793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.686114 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.686466 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.686787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.687109 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.687438 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.687763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.688099 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.688436 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.688756 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.689091 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.689429 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.689789 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.690112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.690580 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.690926 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.691988 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.691988 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.691988 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:57:43.692461 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 14:57:43.741376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO dbcounter [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Registered counter for database nova_api Sep 01 14:57:43.757623 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO dbcounter [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Registered counter for database nova_api Sep 01 14:57:43.765763 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_db.sqlalchemy.engines [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:57:43.773874 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writer thread running {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:57:43.777185 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_db.sqlalchemy.engines [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:57:43.783701 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writer thread running {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:57:43.830214 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.context [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af77895d-00fc-418a-9eb2-bcc92f66925d(cell1) {{(pid=120553) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 14:57:43.834302 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:57:43.834774 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:57:43.836887 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:57:43.837613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:57:43.838061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:57:43.840077 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:57:43.840207 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.context [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),af77895d-00fc-418a-9eb2-bcc92f66925d(cell1) {{(pid=120554) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 14:57:43.842079 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO dbcounter [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Registered counter for database nova_cell0 Sep 01 14:57:43.844203 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:57:43.844698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:57:43.846142 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO dbcounter [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Registered counter for database nova_cell1 Sep 01 14:57:43.846284 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:57:43.847005 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:57:43.847464 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:57:43.849459 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:57:43.851524 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO dbcounter [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Registered counter for database nova_cell0 Sep 01 14:57:43.853513 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_db.sqlalchemy.engines [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:57:43.854857 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_db.sqlalchemy.engines [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:57:43.855801 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO dbcounter [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Registered counter for database nova_cell1 Sep 01 14:57:43.861563 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writer thread running {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:57:43.863306 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_db.sqlalchemy.engines [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:57:43.863825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writer thread running {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:57:43.865079 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_db.sqlalchemy.engines [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:57:43.871097 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writer thread running {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:57:43.872754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writer thread running {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:57:44.007911 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO dbcounter [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Registered counter for database nova_cell0 Sep 01 14:57:44.014609 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_db.sqlalchemy.engines [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:57:44.019270 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writer thread running {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:57:44.021698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO dbcounter [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Registered counter for database nova_cell0 Sep 01 14:57:44.028679 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_db.sqlalchemy.engines [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:57:44.033090 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writer thread running {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:57:44.338468 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: WARNING keystonemiddleware.auth_token [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:57:44.345688 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: WARNING keystonemiddleware.auth_token [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:57:44.353239 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: WARNING keystonemiddleware.auth_token [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:57:44.360493 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: WARNING keystonemiddleware.auth_token [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:57:44.708100 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: WARNING keystonemiddleware.auth_token [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:57:44.712238 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: WARNING keystonemiddleware.auth_token [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:57:44.716467 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: WARNING keystonemiddleware.auth_token [None req-c99674f7-7961-4577-a8d7-de584e479f6e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:57:44.719131 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: WARNING keystonemiddleware.auth_token [None req-5c7e4657-d79f-476b-aa5a-ed9b27b9b4fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:57:44.722058 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a336edb9c0 pid: 120553 (default app) Sep 01 14:57:44.724876 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a336edb9c0 pid: 120554 (default app) Sep 01 14:58:20.887091 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:20.889287 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:20.890462 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:20.892099 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:22.012911 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-0c97e15b-b924-49fe-b12e-ae37e5f7e146 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Action: 'create', calling method: .version_select at 0x7fab78e09280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-821921173", "metadata": {"Type": "work"}}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-0c97e15b-b924-49fe-b12e-ae37e5f7e146 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Request method failure captured: Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 121 Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMiMmWllemgXyVcwryJqwJ6uWxWK6C8RghpmcVv1CqWDyXy42DFeh_HDiKHnssUEP8H6p5MYJJzcS9Wp2sZ20kE-FX98Kuf-Ba_itTxtKKZoMlb6OBzdfwif64jndL5HdD18sKOyxOovydsoCaiT-iWBVhrBpj3WG6RanzpfjGIDfLU Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 14:58:22.045956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54e5a154e23440ce95f4644b4e2ee73f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: c57d26d885514890b8b9d73548e81325 Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-821921173", "metadata": {"Type": "work"}}} Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: Sep 01 14:58:22.048453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-821921173', 'metadata': {'Type': 'work'}}}} Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise error Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:58:22.049401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 14:58:22.050848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 14:58:22.052677 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 14:58:22.052677 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.052677 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-0c97e15b-b924-49fe-b12e-ae37e5f7e146 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:58:22.052677 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-0c97e15b-b924-49fe-b12e-ae37e5f7e146 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.190154 Sep 01 14:58:22.059115 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Sep 1 14:58:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1195 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:58:22.066986 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:22.068254 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:22.069041 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:22.072627 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:22.430720 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0a20c4eb-f454-4208-8d52-4268fe1745e2 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Action: 'create', calling method: .version_select at 0x7fab78ea9f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-652656139", "metadata": {"Type": "work"}}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0a20c4eb-f454-4208-8d52-4268fe1745e2 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Request method failure captured: Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 119 Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMiMmWllemgXyVcwryJqwJ6uWxWK6C8RghpmcVv1CqWDyXy42DFeh_HDiKHnssUEP8H6p5MYJJzcS9Wp2sZ20kE-FX98Kuf-Ba_itTxtKKZoMlb6OBzdfwif64jndL5HdD18sKOyxOovydsoCaiT-iWBVhrBpj3WG6RanzpfjGIDfLU Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 14:58:22.437176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54e5a154e23440ce95f4644b4e2ee73f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: c57d26d885514890b8b9d73548e81325 Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-652656139", "metadata": {"Type": "work"}}} Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: Sep 01 14:58:22.438799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-652656139', 'metadata': {'Type': 'work'}}}} Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise error Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi '0' Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:58:22.439598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 14:58:22.441008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 14:58:22.442420 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 14:58:22.442420 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.444092 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0a20c4eb-f454-4208-8d52-4268fe1745e2 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:58:22.445307 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0a20c4eb-f454-4208-8d52-4268fe1745e2 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.384233 Sep 01 14:58:22.446112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 1/2] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Sep 1 14:58:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 386 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 14:58:22.456799 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-95493ef8-0f00-447c-97ed-a1f153ddea19 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Action: 'create', calling method: .version_select at 0x7fab78e09f70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1977894974", "metadata": {"Type": "work"}}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-95493ef8-0f00-447c-97ed-a1f153ddea19 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Request method failure captured: Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 119 Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMiMmWllemgXyVcwryJqwJ6uWxWK6C8RghpmcVv1CqWDyXy42DFeh_HDiKHnssUEP8H6p5MYJJzcS9Wp2sZ20kE-FX98Kuf-Ba_itTxtKKZoMlb6OBzdfwif64jndL5HdD18sKOyxOovydsoCaiT-iWBVhrBpj3WG6RanzpfjGIDfLU Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 14:58:22.473488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54e5a154e23440ce95f4644b4e2ee73f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: c57d26d885514890b8b9d73548e81325 Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1977894974", "metadata": {"Type": "work"}}} Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: Sep 01 14:58:22.479298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1977894974', 'metadata': {'Type': 'work'}}}} Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise error Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi '' Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:58:22.482630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 14:58:22.487946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 14:58:22.491195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 14:58:22.491195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:22.491195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-95493ef8-0f00-447c-97ed-a1f153ddea19 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:58:22.491896 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-95493ef8-0f00-447c-97ed-a1f153ddea19 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.039684 Sep 01 14:58:22.494284 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Sep 1 14:58:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:58:22.531453 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d1597f93-915d-4e5c-b2b9-c0bf7ac94b52 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Calling method '.version_select at 0x7fab78e719d0>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:23.742621 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-d1597f93-915d-4e5c-b2b9-c0bf7ac94b52 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] HTTP exception thrown: Volume tempest-invalid-1388784510 could not be found. Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d1597f93-915d-4e5c-b2b9-c0bf7ac94b52 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Request method failure captured: Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1388784510 HTTP/1.1 Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMiMmWllemgXyVcwryJqwJ6uWxWK6C8RghpmcVv1CqWDyXy42DFeh_HDiKHnssUEP8H6p5MYJJzcS9Wp2sZ20kE-FX98Kuf-Ba_itTxtKKZoMlb6OBzdfwif64jndL5HdD18sKOyxOovydsoCaiT-iWBVhrBpj3WG6RanzpfjGIDfLU Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 14:58:23.749710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54e5a154e23440ce95f4644b4e2ee73f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: c57d26d885514890b8b9d73548e81325 Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Volume tempest-invalid-1388784510 could not be found. Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': 'tempest-invalid-1388784510'} Sep 01 14:58:23.751388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1388784510 could not be found. (HTTP 404) (Request-ID: req-25d7b7b4-b28b-4348-bf52-0104642e4cb5) Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:23.752349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:58:23.754098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1388784510 could not be found. Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:58:23.756232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1388784510 could not be found. Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1388784510 could not be found. Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d1597f93-915d-4e5c-b2b9-c0bf7ac94b52 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Returning 404 to user: Volume tempest-invalid-1388784510 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:58:23.758463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d1597f93-915d-4e5c-b2b9-c0bf7ac94b52 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1388784510" status: 404 len: 99 microversion: 2.1 time: 1.256001 Sep 01 14:58:23.763090 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Sep 1 14:58:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1388784510 => generated 99 bytes in 1260 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 14:58:23.773755 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6ccda54b-17db-421e-ad72-b15f3c055dd5 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006738 Sep 01 14:58:23.774630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 3/5] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Sep 1 14:58:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 14:58:23.785381 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3fd6c8f2-a4b6-4269-805e-e7a5460b5c50 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004345 Sep 01 14:58:23.785915 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 3/6] 10.222.0.33 () {58 vars in 1137 bytes} [Thu Sep 1 14:58:23 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 14:58:23.796017 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b8b69671-af51-4ee8-8ed7-7aa6ce0493ce tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Calling method '.version_select at 0x7fab78ccd0d0>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:24.111747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-b8b69671-af51-4ee8-8ed7-7aa6ce0493ce tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] HTTP exception thrown: Volume 8298c59e-dabb-4615-9563-dbb906b92507 could not be found. Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b8b69671-af51-4ee8-8ed7-7aa6ce0493ce tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Request method failure captured: Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: DELETE /compute/v2.1/os-volumes/8298c59e-dabb-4615-9563-dbb906b92507 HTTP/1.1 Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMiMmWllemgXyVcwryJqwJ6uWxWK6C8RghpmcVv1CqWDyXy42DFeh_HDiKHnssUEP8H6p5MYJJzcS9Wp2sZ20kE-FX98Kuf-Ba_itTxtKKZoMlb6OBzdfwif64jndL5HdD18sKOyxOovydsoCaiT-iWBVhrBpj3WG6RanzpfjGIDfLU Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 14:58:24.116524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54e5a154e23440ce95f4644b4e2ee73f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: c57d26d885514890b8b9d73548e81325 Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Volume 8298c59e-dabb-4615-9563-dbb906b92507 could not be found. Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '8298c59e-dabb-4615-9563-dbb906b92507'} Sep 01 14:58:24.118183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8298c59e-dabb-4615-9563-dbb906b92507 could not be found. (HTTP 404) (Request-ID: req-36679493-6e01-4acf-b11d-c06dbb9616f8) Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:24.119045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:58:24.120173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8298c59e-dabb-4615-9563-dbb906b92507 could not be found. Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 14:58:24.121352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8298c59e-dabb-4615-9563-dbb906b92507 could not be found. Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8298c59e-dabb-4615-9563-dbb906b92507 could not be found. Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b8b69671-af51-4ee8-8ed7-7aa6ce0493ce tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Returning 404 to user: Volume 8298c59e-dabb-4615-9563-dbb906b92507 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:58:24.122503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b8b69671-af51-4ee8-8ed7-7aa6ce0493ce tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/8298c59e-dabb-4615-9563-dbb906b92507" status: 404 len: 109 microversion: 2.1 time: 0.328684 Sep 01 14:58:24.123301 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 1 14:58:23 2022] DELETE /compute/v2.1/os-volumes/8298c59e-dabb-4615-9563-dbb906b92507 => generated 109 bytes in 331 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:58:24.132824 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e500f424-b003-49fd-8dba-235d56bc50e9 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Calling method '.version_select at 0x7fab7964c550>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:24.272927 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-e500f424-b003-49fd-8dba-235d56bc50e9 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] HTTP exception thrown: Volume 89f8bb24-da12-4971-84c3-7af26658dd0b could not be found. Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e500f424-b003-49fd-8dba-235d56bc50e9 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Request method failure captured: Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/os-volumes/89f8bb24-da12-4971-84c3-7af26658dd0b HTTP/1.1 Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMiMmWllemgXyVcwryJqwJ6uWxWK6C8RghpmcVv1CqWDyXy42DFeh_HDiKHnssUEP8H6p5MYJJzcS9Wp2sZ20kE-FX98Kuf-Ba_itTxtKKZoMlb6OBzdfwif64jndL5HdD18sKOyxOovydsoCaiT-iWBVhrBpj3WG6RanzpfjGIDfLU Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 14:58:24.275626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54e5a154e23440ce95f4644b4e2ee73f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54e5a154e23440ce95f4644b4e2ee73f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 54e5a154e23440ce95f4644b4e2ee73f Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-VolumesNegativeTest-1601130011 Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: c57d26d885514890b8b9d73548e81325 Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-VolumesNegativeTest-1601130011-project Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Volume 89f8bb24-da12-4971-84c3-7af26658dd0b could not be found. Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '89f8bb24-da12-4971-84c3-7af26658dd0b'} Sep 01 14:58:24.276960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89f8bb24-da12-4971-84c3-7af26658dd0b could not be found. (HTTP 404) (Request-ID: req-bcd77b0c-6c2c-40cf-8e67-70b8c4d05f97) Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:24.277834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:58:24.279528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89f8bb24-da12-4971-84c3-7af26658dd0b could not be found. Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:58:24.280666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89f8bb24-da12-4971-84c3-7af26658dd0b could not be found. Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89f8bb24-da12-4971-84c3-7af26658dd0b could not be found. Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e500f424-b003-49fd-8dba-235d56bc50e9 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] Returning 404 to user: Volume 89f8bb24-da12-4971-84c3-7af26658dd0b could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e500f424-b003-49fd-8dba-235d56bc50e9 tempest-VolumesNegativeTest-1601130011 tempest-VolumesNegativeTest-1601130011-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/89f8bb24-da12-4971-84c3-7af26658dd0b" status: 404 len: 109 microversion: 2.1 time: 0.150301 Sep 01 14:58:24.283647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 14:58:24 2022] GET /compute/v2.1/os-volumes/89f8bb24-da12-4971-84c3-7af26658dd0b => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:58:36.133182 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5e16d414-faec-4a13-b9cc-587249cd6bda tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Action: 'create', calling method: .version_select at 0x7fab78c5db80>, body: {"keypair": {"name": "tempest-keypair-168008325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkPTg/nZTPzgldu3SGq+Bl/yE5oGN6yncA3nOcLZFRVp8yO7eRJ3JSrD+jlutR7P8yvZiamhnPEKWrBfQbVBK1MAUJAsMX1hbg9vzy9YA3GpbiLMg/Flcy+RTPDB8EVAg=="}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:36.232318 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-5e16d414-faec-4a13-b9cc-587249cd6bda tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Getting quotas for project 2f02a6da81c440f9b61e4f2f90f37048. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:58:36.259052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-5e16d414-faec-4a13-b9cc-587249cd6bda tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Getting quotas for user 229e076684dd4bbdacda2231b18f0875 and project 2f02a6da81c440f9b61e4f2f90f37048. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:58:36.403237 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5e16d414-faec-4a13-b9cc-587249cd6bda tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.858953 Sep 01 14:58:36.404690 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 5/9] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Sep 1 14:58:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 861 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 14:58:38.241485 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1813208702", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:38.481886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.network.neutron [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] validate_networks() for [('b24b76ad-94a6-47fa-b4fa-c9e8cd11ca83', None, None, None, None, None)] {{(pid=120554) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:58:39.317359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cc7aa565-d38a-4801-b524-8c7cdc1160d6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Action: 'create', calling method: .version_select at 0x7fab78bd14c0>, body: {"keypair": {"name": "tempest-keypair-1094713076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQXATSnimpx4xba/tGRWql5RbGS88wfSqUwFgn4pRQi6/Hk0Wb4tawILrxOXA1+oAhjzsP8JUMJ82ErM8i51EwC7xoDzickRl1focVgGvoQVbBGgpsuG251t+fLMEWzyg=="}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:39.371194 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-cc7aa565-d38a-4801-b524-8c7cdc1160d6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Getting quotas for project b0202aa985634c8b8b241ce016600b19. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:58:39.387406 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-cc7aa565-d38a-4801-b524-8c7cdc1160d6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Getting quotas for user 82255a5060674d77a554e34f89ab1bff and project b0202aa985634c8b8b241ce016600b19. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:58:39.438230 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cc7aa565-d38a-4801-b524-8c7cdc1160d6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.284106 Sep 01 14:58:39.438838 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 6/10] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 1 14:58:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:58:40.845329 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1504884186", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "networks": [{"uuid": "b0d74aad-8de7-4280-844f-bc49cb0bcb12"}]}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:41.023771 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.network.neutron [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] validate_networks() for [('b0d74aad-8de7-4280-844f-bc49cb0bcb12', None, None, None, None, None)] {{(pid=120553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:58:41.325279 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Flavor limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:58:41.325835 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Image limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:58:41.326188 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Flavor pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:58:41.326654 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Image pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:58:41.327079 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:58:41.367010 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:41.367426 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:41.371025 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:41.375377 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:41.377603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:41.378697 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:41.493230 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Getting quotas for project 05e111f88e784eba929741c3cd250e78. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:58:41.511711 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Getting quotas for user df75151c37f74b6da7428dc290a274ff and project 05e111f88e784eba929741c3cd250e78. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:58:41.546280 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Going to run 1 instances... {{(pid=120554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:58:41.557054 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:58:41.842231 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7020c41c-2316-4edc-8b93-8a1570e86e51 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.908159 Sep 01 14:58:41.856775 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 5/11] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 14:58:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 3923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:58:41.885409 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2f685ecb-fbc1-42e6-9919-d54ee8c67a3e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:41.889063 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2f685ecb-fbc1-42e6-9919-d54ee8c67a3e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:42.106349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2f685ecb-fbc1-42e6-9919-d54ee8c67a3e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:42.146987 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2f685ecb-fbc1-42e6-9919-d54ee8c67a3e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1222 microversion: 2.1 time: 0.283830 Sep 01 14:58:42.149815 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:41 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1222 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:58:42.812225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-315867292", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:42.996339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.network.neutron [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] validate_networks() for [('b24b76ad-94a6-47fa-b4fa-c9e8cd11ca83', None, None, None, None, None)] {{(pid=120554) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:58:44.353063 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Flavor limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:58:44.354345 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Image limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:58:44.354994 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Flavor pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:58:44.355557 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Image pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:58:44.356457 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:58:44.409392 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:44.412029 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:44.414550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:44.423504 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:44.425922 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:44.431162 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:44.534702 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Getting quotas for project d925def3f55b435bb5452a0b5e5daff5. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:58:44.559498 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Getting quotas for user bb7098b844d743f5bafeb7ba15b3fdd7 and project d925def3f55b435bb5452a0b5e5daff5. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:58:44.600103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Going to run 1 instances... {{(pid=120553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:58:44.612437 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:58:44.814112 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-22f243d4-25b3-4eb6-a438-7bbf28ad657d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.190031 Sep 01 14:58:44.824500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 7/13] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 14:58:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 4203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 14:58:44.855244 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-772177304", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "385d3105-2fe8-4ab1-9773-5b604909969c"}], "security_groups": [{"name": "tempest-securitygroup--814849543"}], "key_name": "tempest-keypair-168008325", "user_data": "}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:45.338063 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.network.neutron [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] validate_networks() for [('385d3105-2fe8-4ab1-9773-5b604909969c', None, None, None, None, None)] {{(pid=120553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:58:45.856429 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Flavor limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:58:45.857026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Image limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:58:45.857621 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Flavor pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:58:45.858286 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Image pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:58:45.858808 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:58:45.896221 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:45.899035 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:45.907827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:45.913751 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:45.917789 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:45.918628 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:45.997965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Getting quotas for project 05e111f88e784eba929741c3cd250e78. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:58:46.010679 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Getting quotas for user df75151c37f74b6da7428dc290a274ff and project 05e111f88e784eba929741c3cd250e78. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:58:46.034691 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Going to run 1 instances... {{(pid=120554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:58:46.037633 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:58:46.121244 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e1514fdb-a914-4908-b520-442698ef80f9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.330277 Sep 01 14:58:46.123973 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 7/14] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 14:58:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 3335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:58:46.134033 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a2fc3255-db74-4f97-8295-d9c678ca51a7 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:46.135638 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a2fc3255-db74-4f97-8295-d9c678ca51a7 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:46.374167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a2fc3255-db74-4f97-8295-d9c678ca51a7 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:46.418662 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a2fc3255-db74-4f97-8295-d9c678ca51a7 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1215 microversion: 2.1 time: 0.275832 Sep 01 14:58:46.422911 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 8/15] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:46 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1215 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:58:46.454127 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-efbe330b-feae-4eb5-bf71-070df52c8a75 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:46.458011 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-efbe330b-feae-4eb5-bf71-070df52c8a75 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:46.761292 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Flavor limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:58:46.761798 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Image limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:58:46.762383 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Flavor pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:58:46.763049 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Image pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:58:46.763473 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:58:46.796690 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:46.797271 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:46.800652 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:46.801528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:46.802010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:46.806586 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:46.845423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Getting quotas for project 2f02a6da81c440f9b61e4f2f90f37048. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:58:46.863140 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Getting quotas for user 229e076684dd4bbdacda2231b18f0875 and project 2f02a6da81c440f9b61e4f2f90f37048. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:58:46.927963 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Going to run 1 instances... {{(pid=120553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:58:46.938713 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:58:47.123037 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-aa1d8caa-ac3d-4686-8534-6908e155fd23 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.297277 Sep 01 14:58:47.128261 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 8/16] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Sep 1 14:58:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 2303 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 14:58:47.136849 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b6657c13-a04e-425e-9998-1b37f6732301 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:47.137713 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b6657c13-a04e-425e-9998-1b37f6732301 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:47.138660 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-efbe330b-feae-4eb5-bf71-070df52c8a75 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:47.155592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-efbe330b-feae-4eb5-bf71-070df52c8a75 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1221 microversion: 2.1 time: 0.725744 Sep 01 14:58:47.170031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 9/17] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:46 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1221 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:58:47.363339 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b6657c13-a04e-425e-9998-1b37f6732301 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:47.399725 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b6657c13-a04e-425e-9998-1b37f6732301 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:47.404083 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b6657c13-a04e-425e-9998-1b37f6732301 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:47.409482 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b6657c13-a04e-425e-9998-1b37f6732301 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1280 microversion: 2.20 time: 0.274397 Sep 01 14:58:47.422763 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 9/18] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:58:47 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1280 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:58:47.446410 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-dda596fb-546d-4806-97d9-9d714b726f0a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:47.449246 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-dda596fb-546d-4806-97d9-9d714b726f0a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:47.487508 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dda596fb-546d-4806-97d9-9d714b726f0a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:47.490590 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dda596fb-546d-4806-97d9-9d714b726f0a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:47.491074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dda596fb-546d-4806-97d9-9d714b726f0a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:47.496252 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dda596fb-546d-4806-97d9-9d714b726f0a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:47.509691 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dda596fb-546d-4806-97d9-9d714b726f0a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:47.513007 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dda596fb-546d-4806-97d9-9d714b726f0a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:48.178891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b330dc92-ff44-49a3-8b48-8d011f59730b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:48.180598 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b330dc92-ff44-49a3-8b48-8d011f59730b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:48.198316 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b330dc92-ff44-49a3-8b48-8d011f59730b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:48.199588 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b330dc92-ff44-49a3-8b48-8d011f59730b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:48.202356 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b330dc92-ff44-49a3-8b48-8d011f59730b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:48.216292 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b330dc92-ff44-49a3-8b48-8d011f59730b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:48.217300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b330dc92-ff44-49a3-8b48-8d011f59730b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:48.223169 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b330dc92-ff44-49a3-8b48-8d011f59730b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:48.468944 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-dda596fb-546d-4806-97d9-9d714b726f0a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:48.502800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-dda596fb-546d-4806-97d9-9d714b726f0a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1211 microversion: 2.1 time: 1.061626 Sep 01 14:58:48.506130 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 10/19] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:47 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1211 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:58:48.534339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c22688ca-9aa6-4d9c-b477-cc83fe0fcf07 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:48.540048 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c22688ca-9aa6-4d9c-b477-cc83fe0fcf07 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:48.896818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b330dc92-ff44-49a3-8b48-8d011f59730b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:48.946781 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b330dc92-ff44-49a3-8b48-8d011f59730b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1273 microversion: 2.1 time: 0.773620 Sep 01 14:58:48.951983 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 10/20] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:48 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1273 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:58:49.015982 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c22688ca-9aa6-4d9c-b477-cc83fe0fcf07 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:49.026984 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c22688ca-9aa6-4d9c-b477-cc83fe0fcf07 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:49.054978 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c22688ca-9aa6-4d9c-b477-cc83fe0fcf07 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:49.064072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c22688ca-9aa6-4d9c-b477-cc83fe0fcf07 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1280 microversion: 2.20 time: 0.555280 Sep 01 14:58:49.091285 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 11/21] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:58:48 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1280 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:58:49.531912 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bc4f6d61-ea0e-4ec4-b42c-4af5380d9799 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:49.539159 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-bc4f6d61-ea0e-4ec4-b42c-4af5380d9799 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:49.552091 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc4f6d61-ea0e-4ec4-b42c-4af5380d9799 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:49.552645 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc4f6d61-ea0e-4ec4-b42c-4af5380d9799 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:49.553026 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc4f6d61-ea0e-4ec4-b42c-4af5380d9799 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:49.553748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc4f6d61-ea0e-4ec4-b42c-4af5380d9799 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:49.554500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc4f6d61-ea0e-4ec4-b42c-4af5380d9799 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:49.554935 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc4f6d61-ea0e-4ec4-b42c-4af5380d9799 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:49.745148 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-bc4f6d61-ea0e-4ec4-b42c-4af5380d9799 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:49.764308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-bc4f6d61-ea0e-4ec4-b42c-4af5380d9799 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1267 microversion: 2.1 time: 0.228175 Sep 01 14:58:49.769298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 11/22] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:49 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:58:49.823398 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1183866137", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b57541cd-ea40-4950-9bc3-3ee45df99819"}], "security_groups": [{"name": "tempest-securitygroup--547996969"}], "key_name": "tempest-keypair-1094713076", "user_data": "}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:49.977810 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e41ebb36-75da-4251-9436-130e9b6bbe7a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:49.978484 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e41ebb36-75da-4251-9436-130e9b6bbe7a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:49.994908 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e41ebb36-75da-4251-9436-130e9b6bbe7a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:49.995434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e41ebb36-75da-4251-9436-130e9b6bbe7a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:49.995890 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e41ebb36-75da-4251-9436-130e9b6bbe7a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:49.996623 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e41ebb36-75da-4251-9436-130e9b6bbe7a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:49.997090 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e41ebb36-75da-4251-9436-130e9b6bbe7a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:49.997522 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e41ebb36-75da-4251-9436-130e9b6bbe7a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:50.336947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e41ebb36-75da-4251-9436-130e9b6bbe7a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:50.351619 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e41ebb36-75da-4251-9436-130e9b6bbe7a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1279 microversion: 2.1 time: 0.377522 Sep 01 14:58:50.352818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 12/23] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:49 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1279 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:58:50.367132 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:50.368024 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:50.375908 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:50.378890 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:50.380081 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:50.383348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:50.383983 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:50.384585 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:50.555832 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:50.573262 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:50.575988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:50.579973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4b38e993-6fcc-4843-a066-829e96badf02 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1332 microversion: 2.20 time: 0.225960 Sep 01 14:58:50.583581 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 13/24] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:58:50 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1332 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:58:50.793378 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7c8d480b-d0de-4e63-8663-605ce98efe2c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:50.794008 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7c8d480b-d0de-4e63-8663-605ce98efe2c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:50.811043 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c8d480b-d0de-4e63-8663-605ce98efe2c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:50.811473 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c8d480b-d0de-4e63-8663-605ce98efe2c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:50.811922 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c8d480b-d0de-4e63-8663-605ce98efe2c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:50.812651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c8d480b-d0de-4e63-8663-605ce98efe2c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:50.813116 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c8d480b-d0de-4e63-8663-605ce98efe2c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:50.818121 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c8d480b-d0de-4e63-8663-605ce98efe2c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:50.953063 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-7c8d480b-d0de-4e63-8663-605ce98efe2c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:50.965058 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7c8d480b-d0de-4e63-8663-605ce98efe2c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1267 microversion: 2.1 time: 0.175503 Sep 01 14:58:50.966115 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 14/25] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:50 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:58:51.375958 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9a12beee-8582-4f5d-be4c-5139bc4dd158 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:51.376897 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9a12beee-8582-4f5d-be4c-5139bc4dd158 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:51.385551 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a12beee-8582-4f5d-be4c-5139bc4dd158 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:51.395826 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a12beee-8582-4f5d-be4c-5139bc4dd158 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:51.415673 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a12beee-8582-4f5d-be4c-5139bc4dd158 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:51.420875 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a12beee-8582-4f5d-be4c-5139bc4dd158 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:51.422878 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a12beee-8582-4f5d-be4c-5139bc4dd158 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:51.424964 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a12beee-8582-4f5d-be4c-5139bc4dd158 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:51.689411 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9a12beee-8582-4f5d-be4c-5139bc4dd158 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:51.749581 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9a12beee-8582-4f5d-be4c-5139bc4dd158 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1279 microversion: 2.1 time: 0.377637 Sep 01 14:58:51.750827 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 15/26] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:51 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1279 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:58:51.768347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:51.769427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:51.778195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:51.786352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:51.787166 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:51.788131 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:51.788815 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:51.789473 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:51.924874 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:51.936086 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:51.940344 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:51.943492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-916e041e-a276-4ee8-be27-fb580d68bc3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1332 microversion: 2.20 time: 0.191478 Sep 01 14:58:51.944896 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 16/27] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:58:51 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1332 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:58:51.986265 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-13f66330-33fe-4e60-abac-43f557ed075a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:51.987010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-13f66330-33fe-4e60-abac-43f557ed075a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:51.995379 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-13f66330-33fe-4e60-abac-43f557ed075a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:51.996295 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-13f66330-33fe-4e60-abac-43f557ed075a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:51.997217 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-13f66330-33fe-4e60-abac-43f557ed075a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:51.999139 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-13f66330-33fe-4e60-abac-43f557ed075a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:52.000549 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-13f66330-33fe-4e60-abac-43f557ed075a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:52.001340 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-13f66330-33fe-4e60-abac-43f557ed075a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:52.228715 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-13f66330-33fe-4e60-abac-43f557ed075a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:52.253640 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-13f66330-33fe-4e60-abac-43f557ed075a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1273 microversion: 2.1 time: 0.269931 Sep 01 14:58:52.257726 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 17/28] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:51 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:58:52.777345 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-751fe22a-6f0d-4583-8eae-edc0e274a08f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:52.780259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-751fe22a-6f0d-4583-8eae-edc0e274a08f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:52.803248 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-751fe22a-6f0d-4583-8eae-edc0e274a08f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:52.805688 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-751fe22a-6f0d-4583-8eae-edc0e274a08f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:52.807896 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-751fe22a-6f0d-4583-8eae-edc0e274a08f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:52.811438 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-751fe22a-6f0d-4583-8eae-edc0e274a08f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:52.812078 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-751fe22a-6f0d-4583-8eae-edc0e274a08f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:52.813798 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-751fe22a-6f0d-4583-8eae-edc0e274a08f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:53.869849 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-751fe22a-6f0d-4583-8eae-edc0e274a08f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:53.878919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-751fe22a-6f0d-4583-8eae-edc0e274a08f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1279 microversion: 2.1 time: 1.107188 Sep 01 14:58:53.886643 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 18/29] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:52 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1279 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:58:53.902707 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:53.904861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:53.922115 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:53.923824 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:53.924691 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:53.939745 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:53.946432 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:53.948028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:54.291022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:54.304616 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:54.306568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:54.308048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-092f51f2-c082-4e74-bd46-86a72833dd91 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1338 microversion: 2.20 time: 0.420251 Sep 01 14:58:54.340897 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 19/30] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:58:53 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1338 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:58:54.346161 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-11824ee8-75a8-4f35-867f-f3611d9016c0 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:54.354775 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-11824ee8-75a8-4f35-867f-f3611d9016c0 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:54.375666 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11824ee8-75a8-4f35-867f-f3611d9016c0 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:54.386275 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11824ee8-75a8-4f35-867f-f3611d9016c0 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:54.387225 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11824ee8-75a8-4f35-867f-f3611d9016c0 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:54.388515 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11824ee8-75a8-4f35-867f-f3611d9016c0 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:54.389548 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11824ee8-75a8-4f35-867f-f3611d9016c0 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:54.392499 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11824ee8-75a8-4f35-867f-f3611d9016c0 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:55.935122 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=4 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:56.256591 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-11824ee8-75a8-4f35-867f-f3611d9016c0 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:56.270918 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-11824ee8-75a8-4f35-867f-f3611d9016c0 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 1.928494 Sep 01 14:58:56.291434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 20/31] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:54 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:58:56.299919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-88cd3acd-575f-4784-962e-9a44e8646d24 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:56.304797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-88cd3acd-575f-4784-962e-9a44e8646d24 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:56.342416 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-88cd3acd-575f-4784-962e-9a44e8646d24 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:56.354481 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-88cd3acd-575f-4784-962e-9a44e8646d24 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:56.354481 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-88cd3acd-575f-4784-962e-9a44e8646d24 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:56.354481 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-88cd3acd-575f-4784-962e-9a44e8646d24 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:56.357450 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-88cd3acd-575f-4784-962e-9a44e8646d24 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:56.358634 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-88cd3acd-575f-4784-962e-9a44e8646d24 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:56.824953 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=4 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:57.393577 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=22 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:57.538604 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-88cd3acd-575f-4784-962e-9a44e8646d24 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:57.549614 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-88cd3acd-575f-4784-962e-9a44e8646d24 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 1.255529 Sep 01 14:58:57.565421 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 21/32] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:56 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:58:57.576230 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:57.578276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:57.601761 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:57.602625 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:57.604072 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:57.605266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:57.608948 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:57.610848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:57.839407 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:57.856248 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:57.858052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:57.859411 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b8cdd7ff-8c7e-4bf4-bfdc-543df6d0e93e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1338 microversion: 2.20 time: 0.292637 Sep 01 14:58:57.863767 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 22/33] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:58:57 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1338 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:58:57.878086 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f11a72b6-5f43-4c42-9099-84e8e6a203ac tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:57.879494 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f11a72b6-5f43-4c42-9099-84e8e6a203ac tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:57.888836 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11a72b6-5f43-4c42-9099-84e8e6a203ac tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:57.889428 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11a72b6-5f43-4c42-9099-84e8e6a203ac tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:57.889934 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11a72b6-5f43-4c42-9099-84e8e6a203ac tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:57.890879 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11a72b6-5f43-4c42-9099-84e8e6a203ac tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:57.891287 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11a72b6-5f43-4c42-9099-84e8e6a203ac tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:57.892075 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11a72b6-5f43-4c42-9099-84e8e6a203ac tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:58.451464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f11a72b6-5f43-4c42-9099-84e8e6a203ac tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:58.459710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f11a72b6-5f43-4c42-9099-84e8e6a203ac tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.594693 Sep 01 14:58:58.460288 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 23/34] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:57 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:58:58.476579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=10 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:58.616345 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-fe0ffaa1-dea0-4c0f-9541-e2a5473c1eff req-f3f2fc3c-02d1-42cb-a333-b9687ab2fe95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dda2c56-8fb3-4c9f-8942-9c1cf30ec182", "tag": "8f730b34-940d-4091-b2c0-79234034252e"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:58.651955 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-fe0ffaa1-dea0-4c0f-9541-e2a5473c1eff req-f3f2fc3c-02d1-42cb-a333-b9687ab2fe95 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:58.652441 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-fe0ffaa1-dea0-4c0f-9541-e2a5473c1eff req-f3f2fc3c-02d1-42cb-a333-b9687ab2fe95 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:58.652872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-fe0ffaa1-dea0-4c0f-9541-e2a5473c1eff req-f3f2fc3c-02d1-42cb-a333-b9687ab2fe95 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:58.711574 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-fe0ffaa1-dea0-4c0f-9541-e2a5473c1eff req-f3f2fc3c-02d1-42cb-a333-b9687ab2fe95 service nova] Creating event network-changed:8f730b34-940d-4091-b2c0-79234034252e for instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 on hv-cinder-85505 Sep 01 14:58:58.712338 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-fe0ffaa1-dea0-4c0f-9541-e2a5473c1eff req-f3f2fc3c-02d1-42cb-a333-b9687ab2fe95 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 14:58:58.713203 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-fe0ffaa1-dea0-4c0f-9541-e2a5473c1eff req-f3f2fc3c-02d1-42cb-a333-b9687ab2fe95 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 14:58:58.714537 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036b833e-2218-410d-9728-1f4d1b2460ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:58.715577 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036b833e-2218-410d-9728-1f4d1b2460ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:58.716549 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036b833e-2218-410d-9728-1f4d1b2460ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:58.717480 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036b833e-2218-410d-9728-1f4d1b2460ba None None] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:58.718473 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036b833e-2218-410d-9728-1f4d1b2460ba None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:58.719407 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036b833e-2218-410d-9728-1f4d1b2460ba None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:58.734204 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.compute.rpcapi [None req-036b833e-2218-410d-9728-1f4d1b2460ba None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 14:58:58.735238 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036b833e-2218-410d-9728-1f4d1b2460ba None None] Releasing lock "compute-rpcapi-router" {{(pid=120553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 14:58:58.761379 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-036b833e-2218-410d-9728-1f4d1b2460ba None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296700 Sep 01 14:58:58.763310 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 24/35] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:58:58.849728 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.network.neutron [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] validate_networks() for [('b57541cd-ea40-4950-9bc3-3ee45df99819', None, None, None, None, None)] {{(pid=120554) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:58:58.884948 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-42255869-9c2a-4db4-a8ff-54df055f6299 req-0bdf7031-b988-42ca-ba6f-531ae8f39277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7322e2bb-f39f-46ee-9193-1edd605d833f", "tag": "15dcee05-385b-4dbf-9d4a-1e83e723059e"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:58:58.912028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-42255869-9c2a-4db4-a8ff-54df055f6299 req-0bdf7031-b988-42ca-ba6f-531ae8f39277 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:58.912682 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-42255869-9c2a-4db4-a8ff-54df055f6299 req-0bdf7031-b988-42ca-ba6f-531ae8f39277 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:58.913268 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-42255869-9c2a-4db4-a8ff-54df055f6299 req-0bdf7031-b988-42ca-ba6f-531ae8f39277 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:58.937788 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-42255869-9c2a-4db4-a8ff-54df055f6299 req-0bdf7031-b988-42ca-ba6f-531ae8f39277 service nova] Creating event network-changed:15dcee05-385b-4dbf-9d4a-1e83e723059e for instance 7322e2bb-f39f-46ee-9193-1edd605d833f on hv-cinder-85505 Sep 01 14:58:58.948589 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-42255869-9c2a-4db4-a8ff-54df055f6299 req-0bdf7031-b988-42ca-ba6f-531ae8f39277 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183670 Sep 01 14:58:58.949545 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 25/36] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:58:58.987595 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-659b4d48-da67-4c42-9e23-dc8da7c841be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:58.990027 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-659b4d48-da67-4c42-9e23-dc8da7c841be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:59.001390 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-659b4d48-da67-4c42-9e23-dc8da7c841be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:59.002664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-659b4d48-da67-4c42-9e23-dc8da7c841be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:59.003287 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-659b4d48-da67-4c42-9e23-dc8da7c841be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:59.006660 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-659b4d48-da67-4c42-9e23-dc8da7c841be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:59.007304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-659b4d48-da67-4c42-9e23-dc8da7c841be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:59.015653 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-659b4d48-da67-4c42-9e23-dc8da7c841be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:59.020979 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=20 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:59.708592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-659b4d48-da67-4c42-9e23-dc8da7c841be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:58:59.723383 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=100 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:58:59.729872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-659b4d48-da67-4c42-9e23-dc8da7c841be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.757290 Sep 01 14:58:59.745115 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 26/37] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:58:58 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:58:59.751655 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:58:59.755082 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:58:59.771423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:59.774480 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:59.774935 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:58:59.775700 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:58:59.776131 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:58:59.776579 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:00.120870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Flavor limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:59:00.121405 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Image limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:59:00.121779 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Flavor pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:59:00.122196 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Image pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:59:00.122642 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:59:00.132975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:00.133485 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:00.133928 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:00.134714 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:00.135181 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:00.135686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:00.163476 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Getting quotas for project b0202aa985634c8b8b241ce016600b19. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:59:00.168938 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Getting quotas for user 82255a5060674d77a554e34f89ab1bff and project b0202aa985634c8b8b241ce016600b19. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:59:00.205306 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Going to run 1 instances... {{(pid=120554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:59:00.208277 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:59:00.279161 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2fa88f5c-ea13-4085-9cfa-6f36bf854ee4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 10.465024 Sep 01 14:59:00.280781 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 12/38] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 14:58:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 10467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:59:00.290985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-bb15560e-264a-4e07-8390-9b40ed19080d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:00.292144 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-bb15560e-264a-4e07-8390-9b40ed19080d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:00.314223 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bb15560e-264a-4e07-8390-9b40ed19080d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:00.316171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bb15560e-264a-4e07-8390-9b40ed19080d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:00.318452 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bb15560e-264a-4e07-8390-9b40ed19080d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:00.320016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bb15560e-264a-4e07-8390-9b40ed19080d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:00.320805 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bb15560e-264a-4e07-8390-9b40ed19080d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:00.321315 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bb15560e-264a-4e07-8390-9b40ed19080d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:00.614484 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-bb15560e-264a-4e07-8390-9b40ed19080d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:00.624032 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-bb15560e-264a-4e07-8390-9b40ed19080d tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.341767 Sep 01 14:59:00.625453 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 13/39] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:00 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:00.640793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-786966b6-bca9-4ed8-a21b-98a80b661f16 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:00.641852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-786966b6-bca9-4ed8-a21b-98a80b661f16 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:00.725153 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-786966b6-bca9-4ed8-a21b-98a80b661f16 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:00.732911 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-786966b6-bca9-4ed8-a21b-98a80b661f16 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1238 microversion: 2.1 time: 0.105808 Sep 01 14:59:00.734415 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 14/40] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:00 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:00.754787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5c08ab1b-5658-45d6-bd0c-3f21872e78df tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:00.755811 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5c08ab1b-5658-45d6-bd0c-3f21872e78df tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:00.763509 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c08ab1b-5658-45d6-bd0c-3f21872e78df tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:00.764387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c08ab1b-5658-45d6-bd0c-3f21872e78df tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:00.765160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c08ab1b-5658-45d6-bd0c-3f21872e78df tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:00.766188 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c08ab1b-5658-45d6-bd0c-3f21872e78df tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:00.767546 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c08ab1b-5658-45d6-bd0c-3f21872e78df tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:00.768206 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c08ab1b-5658-45d6-bd0c-3f21872e78df tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:00.793605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:00.810321 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:00.812889 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:00.813995 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-08e15c11-d954-4c4b-9027-2f0cb8e1f992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 1.067851 Sep 01 14:59:00.814872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 27/41] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:58:59 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:01.011677 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-c3513761-2418-4c4a-b156-dcf3c2445fc0 req-aa08947d-dcff-44d6-9846-713f744e574d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f43e2a43-72fe-4b29-81be-c508b9c9d354", "tag": "a4b9afd8-08b0-4b00-a627-9a2d62a2f5a2"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:01.020992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:01.031069 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-5c08ab1b-5658-45d6-bd0c-3f21872e78df tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:01.033334 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-c3513761-2418-4c4a-b156-dcf3c2445fc0 req-aa08947d-dcff-44d6-9846-713f744e574d service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:01.033828 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-c3513761-2418-4c4a-b156-dcf3c2445fc0 req-aa08947d-dcff-44d6-9846-713f744e574d service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:01.037673 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-c3513761-2418-4c4a-b156-dcf3c2445fc0 req-aa08947d-dcff-44d6-9846-713f744e574d service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:01.044875 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5c08ab1b-5658-45d6-bd0c-3f21872e78df tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.296130 Sep 01 14:59:01.048133 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 15/42] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:00 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:01.056566 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-c3513761-2418-4c4a-b156-dcf3c2445fc0 req-aa08947d-dcff-44d6-9846-713f744e574d service nova] Creating event network-changed:a4b9afd8-08b0-4b00-a627-9a2d62a2f5a2 for instance f43e2a43-72fe-4b29-81be-c508b9c9d354 on hv-cinder-85505 Sep 01 14:59:01.077873 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-c3513761-2418-4c4a-b156-dcf3c2445fc0 req-aa08947d-dcff-44d6-9846-713f744e574d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069209 Sep 01 14:59:01.079148 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 28/43] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:59:01.647165 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ac115766-b38a-48be-95a7-5c98e24cd05a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:01.648319 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ac115766-b38a-48be-95a7-5c98e24cd05a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:01.655531 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac115766-b38a-48be-95a7-5c98e24cd05a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:01.655531 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac115766-b38a-48be-95a7-5c98e24cd05a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:01.655531 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac115766-b38a-48be-95a7-5c98e24cd05a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:01.656106 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac115766-b38a-48be-95a7-5c98e24cd05a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:01.656725 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac115766-b38a-48be-95a7-5c98e24cd05a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:01.657241 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac115766-b38a-48be-95a7-5c98e24cd05a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:01.759675 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6f2aeb71-2a1c-4124-8a94-496f92e2f550 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:01.760380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6f2aeb71-2a1c-4124-8a94-496f92e2f550 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:01.766840 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f2aeb71-2a1c-4124-8a94-496f92e2f550 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:01.767332 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f2aeb71-2a1c-4124-8a94-496f92e2f550 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:01.767897 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f2aeb71-2a1c-4124-8a94-496f92e2f550 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:01.768602 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f2aeb71-2a1c-4124-8a94-496f92e2f550 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:01.769064 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f2aeb71-2a1c-4124-8a94-496f92e2f550 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:01.770103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f2aeb71-2a1c-4124-8a94-496f92e2f550 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:01.796175 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ac115766-b38a-48be-95a7-5c98e24cd05a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:01.805212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ac115766-b38a-48be-95a7-5c98e24cd05a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.162069 Sep 01 14:59:01.811110 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 16/44] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:01 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:01.835393 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6f2aeb71-2a1c-4124-8a94-496f92e2f550 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:01.838094 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:01.838756 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:01.844740 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:01.845237 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:01.845932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:01.846675 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:01.847331 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:01.848401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:01.849389 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6f2aeb71-2a1c-4124-8a94-496f92e2f550 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1242 microversion: 2.1 time: 0.094435 Sep 01 14:59:01.850152 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 29/45] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:01 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:01.981874 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:01.990682 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:01.992136 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:01.993253 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7193e13e-8979-48d9-a8f2-294f41ad1286 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.159016 Sep 01 14:59:01.994003 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 17/46] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:01 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:59:02.069573 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9aee92f0-c7cf-40cc-84ea-07888de801d1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:02.070555 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9aee92f0-c7cf-40cc-84ea-07888de801d1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:02.077521 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9aee92f0-c7cf-40cc-84ea-07888de801d1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:02.078073 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9aee92f0-c7cf-40cc-84ea-07888de801d1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:02.078594 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9aee92f0-c7cf-40cc-84ea-07888de801d1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:02.079425 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9aee92f0-c7cf-40cc-84ea-07888de801d1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:02.079979 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9aee92f0-c7cf-40cc-84ea-07888de801d1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:02.080596 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9aee92f0-c7cf-40cc-84ea-07888de801d1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:02.236276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9aee92f0-c7cf-40cc-84ea-07888de801d1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:02.244455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9aee92f0-c7cf-40cc-84ea-07888de801d1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.179429 Sep 01 14:59:02.245018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 30/47] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:02 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:02.826430 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-53c1c7e9-e39d-4b1e-91f1-64bb28068190 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:02.827137 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-53c1c7e9-e39d-4b1e-91f1-64bb28068190 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:02.834061 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-53c1c7e9-e39d-4b1e-91f1-64bb28068190 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:02.834594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-53c1c7e9-e39d-4b1e-91f1-64bb28068190 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:02.835024 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-53c1c7e9-e39d-4b1e-91f1-64bb28068190 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:02.835716 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-53c1c7e9-e39d-4b1e-91f1-64bb28068190 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:02.836173 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-53c1c7e9-e39d-4b1e-91f1-64bb28068190 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:02.836601 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-53c1c7e9-e39d-4b1e-91f1-64bb28068190 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:02.869796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2b67d960-40ef-4aff-8885-9afe80ce5fa0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:02.870540 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2b67d960-40ef-4aff-8885-9afe80ce5fa0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:02.876924 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b67d960-40ef-4aff-8885-9afe80ce5fa0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:02.877633 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b67d960-40ef-4aff-8885-9afe80ce5fa0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:02.878076 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b67d960-40ef-4aff-8885-9afe80ce5fa0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:02.878836 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b67d960-40ef-4aff-8885-9afe80ce5fa0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:02.879445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b67d960-40ef-4aff-8885-9afe80ce5fa0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:02.880027 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b67d960-40ef-4aff-8885-9afe80ce5fa0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:02.946651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2b67d960-40ef-4aff-8885-9afe80ce5fa0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:02.954968 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2b67d960-40ef-4aff-8885-9afe80ce5fa0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1242 microversion: 2.1 time: 0.088815 Sep 01 14:59:02.955656 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 31/48] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:02 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:02.984953 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-53c1c7e9-e39d-4b1e-91f1-64bb28068190 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:02.992451 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-53c1c7e9-e39d-4b1e-91f1-64bb28068190 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.169958 Sep 01 14:59:02.993016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 18/49] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:02 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:03.015746 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:03.016365 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:03.022302 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:03.022795 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:03.023236 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:03.023925 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:03.024386 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:03.024813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:03.126619 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-af961f2b-2922-47f6-9c64-581a9f0a52d1 req-5314a1e8-da6b-4f07-9db3-02aaf49ec309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2570eed9-40bd-40ef-92d6-63b4e3cc83bf", "tag": "2edcc91b-b083-48b1-bb53-84caae283791"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:03.139016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-af961f2b-2922-47f6-9c64-581a9f0a52d1 req-5314a1e8-da6b-4f07-9db3-02aaf49ec309 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:03.139516 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-af961f2b-2922-47f6-9c64-581a9f0a52d1 req-5314a1e8-da6b-4f07-9db3-02aaf49ec309 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:03.139954 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-af961f2b-2922-47f6-9c64-581a9f0a52d1 req-5314a1e8-da6b-4f07-9db3-02aaf49ec309 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:03.166497 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-af961f2b-2922-47f6-9c64-581a9f0a52d1 req-5314a1e8-da6b-4f07-9db3-02aaf49ec309 service nova] Creating event network-changed:2edcc91b-b083-48b1-bb53-84caae283791 for instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf on hv-cinder-85505 Sep 01 14:59:03.166787 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:03.167034 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-af961f2b-2922-47f6-9c64-581a9f0a52d1 req-5314a1e8-da6b-4f07-9db3-02aaf49ec309 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120554) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 14:59:03.167441 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-af961f2b-2922-47f6-9c64-581a9f0a52d1 req-5314a1e8-da6b-4f07-9db3-02aaf49ec309 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120554) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 14:59:03.168480 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1bb69c-486f-43a7-a3d0-4f6f25faf14f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:03.168967 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1bb69c-486f-43a7-a3d0-4f6f25faf14f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:03.169403 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1bb69c-486f-43a7-a3d0-4f6f25faf14f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:03.170102 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1bb69c-486f-43a7-a3d0-4f6f25faf14f None None] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:03.170654 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1bb69c-486f-43a7-a3d0-4f6f25faf14f None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:03.171076 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1bb69c-486f-43a7-a3d0-4f6f25faf14f None None] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:03.174801 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:03.176312 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:03.177423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-01b05267-ae19-4006-8f7b-f784b06d2449 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.165538 Sep 01 14:59:03.177974 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 32/50] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:03 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:03.189294 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.compute.rpcapi [None req-ea1bb69c-486f-43a7-a3d0-4f6f25faf14f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 14:59:03.190203 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1bb69c-486f-43a7-a3d0-4f6f25faf14f None None] Releasing lock "compute-rpcapi-router" {{(pid=120554) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 14:59:03.214059 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ea1bb69c-486f-43a7-a3d0-4f6f25faf14f None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090613 Sep 01 14:59:03.214342 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 19/51] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:03.265538 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a32b4150-11f6-4d57-80fc-65bbd10b8996 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:03.266161 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a32b4150-11f6-4d57-80fc-65bbd10b8996 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:03.273267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a32b4150-11f6-4d57-80fc-65bbd10b8996 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:03.273795 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a32b4150-11f6-4d57-80fc-65bbd10b8996 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:03.274283 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a32b4150-11f6-4d57-80fc-65bbd10b8996 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:03.274989 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a32b4150-11f6-4d57-80fc-65bbd10b8996 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:03.275453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a32b4150-11f6-4d57-80fc-65bbd10b8996 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:03.275887 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a32b4150-11f6-4d57-80fc-65bbd10b8996 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:03.415338 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a32b4150-11f6-4d57-80fc-65bbd10b8996 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:03.422848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a32b4150-11f6-4d57-80fc-65bbd10b8996 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.161121 Sep 01 14:59:03.423403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 33/52] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:03 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:03.976419 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0077ed4c-3457-4a44-977d-979c05fbdf86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:03.977053 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0077ed4c-3457-4a44-977d-979c05fbdf86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:03.983182 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0077ed4c-3457-4a44-977d-979c05fbdf86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:03.983677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0077ed4c-3457-4a44-977d-979c05fbdf86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:03.984118 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0077ed4c-3457-4a44-977d-979c05fbdf86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:03.984811 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0077ed4c-3457-4a44-977d-979c05fbdf86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:03.985270 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0077ed4c-3457-4a44-977d-979c05fbdf86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:03.985700 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0077ed4c-3457-4a44-977d-979c05fbdf86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:04.012660 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-64ae4c10-ddc6-4c12-bd79-7cc58152378e tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:04.013280 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-64ae4c10-ddc6-4c12-bd79-7cc58152378e tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:04.019390 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-64ae4c10-ddc6-4c12-bd79-7cc58152378e tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:04.019974 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-64ae4c10-ddc6-4c12-bd79-7cc58152378e tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:04.020509 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-64ae4c10-ddc6-4c12-bd79-7cc58152378e tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:04.021275 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-64ae4c10-ddc6-4c12-bd79-7cc58152378e tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:04.021839 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-64ae4c10-ddc6-4c12-bd79-7cc58152378e tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:04.022371 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-64ae4c10-ddc6-4c12-bd79-7cc58152378e tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:04.046272 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0077ed4c-3457-4a44-977d-979c05fbdf86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:04.054628 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0077ed4c-3457-4a44-977d-979c05fbdf86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1242 microversion: 2.1 time: 0.082515 Sep 01 14:59:04.055200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 20/53] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:03 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:04.151249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-64ae4c10-ddc6-4c12-bd79-7cc58152378e tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:04.158770 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-64ae4c10-ddc6-4c12-bd79-7cc58152378e tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.149870 Sep 01 14:59:04.159332 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 34/54] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:04 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:04.199658 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:04.200273 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:04.206130 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:04.206672 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:04.207108 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:04.207795 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:04.208255 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:04.208701 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:04.342571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:04.351391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:04.352843 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:04.353965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b4f2934d-91aa-4bd0-b0b4-68e92e2fd574 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.158356 Sep 01 14:59:04.354586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 21/55] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:04 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:04.443042 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1d90c85f-b1cc-472c-9b33-11b98afc8c99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:04.443653 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1d90c85f-b1cc-472c-9b33-11b98afc8c99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:04.450007 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d90c85f-b1cc-472c-9b33-11b98afc8c99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:04.450521 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d90c85f-b1cc-472c-9b33-11b98afc8c99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:04.450961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d90c85f-b1cc-472c-9b33-11b98afc8c99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:04.451675 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d90c85f-b1cc-472c-9b33-11b98afc8c99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:04.452103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d90c85f-b1cc-472c-9b33-11b98afc8c99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:04.452522 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d90c85f-b1cc-472c-9b33-11b98afc8c99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:04.587745 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1d90c85f-b1cc-472c-9b33-11b98afc8c99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:04.596305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1d90c85f-b1cc-472c-9b33-11b98afc8c99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.156977 Sep 01 14:59:04.596998 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 35/56] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:04 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:05.075919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-aef2b939-9cde-405d-96d0-05c9af7fef63 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:05.076555 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-aef2b939-9cde-405d-96d0-05c9af7fef63 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:05.083096 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aef2b939-9cde-405d-96d0-05c9af7fef63 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:05.083582 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aef2b939-9cde-405d-96d0-05c9af7fef63 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:05.084066 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aef2b939-9cde-405d-96d0-05c9af7fef63 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:05.085049 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aef2b939-9cde-405d-96d0-05c9af7fef63 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:05.085604 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aef2b939-9cde-405d-96d0-05c9af7fef63 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:05.086193 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aef2b939-9cde-405d-96d0-05c9af7fef63 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:05.146096 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-aef2b939-9cde-405d-96d0-05c9af7fef63 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:05.153957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-aef2b939-9cde-405d-96d0-05c9af7fef63 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1242 microversion: 2.1 time: 0.081888 Sep 01 14:59:05.154649 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 22/57] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:05 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:05.178973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9b4407d1-afea-475b-bead-ed8115a9a523 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:05.179600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9b4407d1-afea-475b-bead-ed8115a9a523 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:05.185582 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9b4407d1-afea-475b-bead-ed8115a9a523 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:05.186073 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9b4407d1-afea-475b-bead-ed8115a9a523 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:05.186590 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9b4407d1-afea-475b-bead-ed8115a9a523 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:05.187288 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9b4407d1-afea-475b-bead-ed8115a9a523 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:05.187751 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9b4407d1-afea-475b-bead-ed8115a9a523 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:05.188184 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9b4407d1-afea-475b-bead-ed8115a9a523 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:05.313531 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9b4407d1-afea-475b-bead-ed8115a9a523 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:05.321629 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9b4407d1-afea-475b-bead-ed8115a9a523 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.146701 Sep 01 14:59:05.322380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 36/58] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:05 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:05.377419 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:05.377966 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:05.384482 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:05.384961 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:05.385609 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:05.387039 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:05.387503 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:05.387933 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:05.521608 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:05.529755 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:05.531234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:05.532352 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6c0100b5-b957-4a51-8bee-decf2f7ec831 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.158963 Sep 01 14:59:05.532906 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 23/59] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:05 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:05.618913 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f5083f1e-edaa-406a-b22c-723043813ef6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:05.619540 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f5083f1e-edaa-406a-b22c-723043813ef6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:05.625320 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f5083f1e-edaa-406a-b22c-723043813ef6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:05.625803 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f5083f1e-edaa-406a-b22c-723043813ef6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:05.626265 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f5083f1e-edaa-406a-b22c-723043813ef6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:05.626954 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f5083f1e-edaa-406a-b22c-723043813ef6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:05.627414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f5083f1e-edaa-406a-b22c-723043813ef6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:05.627907 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f5083f1e-edaa-406a-b22c-723043813ef6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:05.758095 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f5083f1e-edaa-406a-b22c-723043813ef6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:05.765640 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f5083f1e-edaa-406a-b22c-723043813ef6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.150572 Sep 01 14:59:05.766193 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 37/60] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:05 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:06.174399 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-947d61b0-4fd2-4947-a63e-410b1a666c8a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:06.175025 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-947d61b0-4fd2-4947-a63e-410b1a666c8a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:06.181232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-947d61b0-4fd2-4947-a63e-410b1a666c8a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:06.181723 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-947d61b0-4fd2-4947-a63e-410b1a666c8a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:06.182166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-947d61b0-4fd2-4947-a63e-410b1a666c8a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:06.182886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-947d61b0-4fd2-4947-a63e-410b1a666c8a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:06.183352 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-947d61b0-4fd2-4947-a63e-410b1a666c8a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:06.183784 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-947d61b0-4fd2-4947-a63e-410b1a666c8a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:06.244592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-947d61b0-4fd2-4947-a63e-410b1a666c8a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:06.252105 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-947d61b0-4fd2-4947-a63e-410b1a666c8a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1242 microversion: 2.1 time: 0.081586 Sep 01 14:59:06.252667 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 24/61] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:06 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:06.347182 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4a9dada3-2fe9-4b6f-b6b5-c547c2fecdf8 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:06.348358 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4a9dada3-2fe9-4b6f-b6b5-c547c2fecdf8 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:06.354210 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9dada3-2fe9-4b6f-b6b5-c547c2fecdf8 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:06.354726 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9dada3-2fe9-4b6f-b6b5-c547c2fecdf8 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:06.355167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9dada3-2fe9-4b6f-b6b5-c547c2fecdf8 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:06.355853 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9dada3-2fe9-4b6f-b6b5-c547c2fecdf8 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:06.356311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9dada3-2fe9-4b6f-b6b5-c547c2fecdf8 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:06.356744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9dada3-2fe9-4b6f-b6b5-c547c2fecdf8 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:06.484593 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4a9dada3-2fe9-4b6f-b6b5-c547c2fecdf8 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:06.492142 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4a9dada3-2fe9-4b6f-b6b5-c547c2fecdf8 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.148818 Sep 01 14:59:06.492758 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 38/62] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:06 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:06.558149 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:06.559507 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:06.572749 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:06.573538 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:06.574152 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:06.575074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:06.575693 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:06.576265 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:06.788199 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6b630d27-c60f-425c-8406-58b6c4925d59 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:06.788845 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6b630d27-c60f-425c-8406-58b6c4925d59 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:06.802477 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b630d27-c60f-425c-8406-58b6c4925d59 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:06.802835 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b630d27-c60f-425c-8406-58b6c4925d59 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:06.803307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b630d27-c60f-425c-8406-58b6c4925d59 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:06.804278 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b630d27-c60f-425c-8406-58b6c4925d59 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:06.804740 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b630d27-c60f-425c-8406-58b6c4925d59 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:06.805162 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b630d27-c60f-425c-8406-58b6c4925d59 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:07.099883 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:07.123620 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:07.129554 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:07.131280 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b375843b-7e1c-46fa-8727-3c672f10b8f3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.580688 Sep 01 14:59:07.132618 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 25/63] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:06 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:07.239784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6b630d27-c60f-425c-8406-58b6c4925d59 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:07.247971 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6b630d27-c60f-425c-8406-58b6c4925d59 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.465358 Sep 01 14:59:07.248738 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 39/64] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:06 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:07.273494 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4de3f70f-49e6-4dfc-9386-914341535208 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:07.274058 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4de3f70f-49e6-4dfc-9386-914341535208 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:07.282767 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4de3f70f-49e6-4dfc-9386-914341535208 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:07.283705 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4de3f70f-49e6-4dfc-9386-914341535208 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:07.284407 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4de3f70f-49e6-4dfc-9386-914341535208 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:07.285815 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4de3f70f-49e6-4dfc-9386-914341535208 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:07.286300 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4de3f70f-49e6-4dfc-9386-914341535208 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:07.287020 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4de3f70f-49e6-4dfc-9386-914341535208 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:07.515253 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6ff8799c-7a2d-4281-a6fc-673ce8555a4b tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:07.516036 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6ff8799c-7a2d-4281-a6fc-673ce8555a4b tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:07.527750 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ff8799c-7a2d-4281-a6fc-673ce8555a4b tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:07.528451 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ff8799c-7a2d-4281-a6fc-673ce8555a4b tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:07.528908 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ff8799c-7a2d-4281-a6fc-673ce8555a4b tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:07.531222 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ff8799c-7a2d-4281-a6fc-673ce8555a4b tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:07.532987 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ff8799c-7a2d-4281-a6fc-673ce8555a4b tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:07.535959 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ff8799c-7a2d-4281-a6fc-673ce8555a4b tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:07.575650 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4de3f70f-49e6-4dfc-9386-914341535208 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:07.587015 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4de3f70f-49e6-4dfc-9386-914341535208 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1290 microversion: 2.1 time: 0.318250 Sep 01 14:59:07.587652 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 26/65] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:07 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1290 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:08.154170 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:08.154829 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:08.156819 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:08.176732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:08.177248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:08.177697 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:08.178703 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:08.184322 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:08.184322 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:08.733314 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:08.745203 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:08.750764 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6ff8799c-7a2d-4281-a6fc-673ce8555a4b tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:08.763609 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:08.765088 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:08.766223 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c4be05fc-665e-47a2-a31e-ca2b96c9e62a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.617081 Sep 01 14:59:08.780334 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6ff8799c-7a2d-4281-a6fc-673ce8555a4b tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 1.270870 Sep 01 14:59:08.782630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 40/66] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:07 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:08.816587 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 27/67] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:08 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:59:08.816587 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-34907c11-6c63-4379-b9b7-cb6781ca368a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:08.816587 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-34907c11-6c63-4379-b9b7-cb6781ca368a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:08.818136 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-74af669a-4c2a-4ae7-805a-f2aa35a70a8d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:08.818810 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-74af669a-4c2a-4ae7-805a-f2aa35a70a8d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:08.832088 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74af669a-4c2a-4ae7-805a-f2aa35a70a8d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:08.832591 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74af669a-4c2a-4ae7-805a-f2aa35a70a8d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:08.833045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74af669a-4c2a-4ae7-805a-f2aa35a70a8d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:08.833761 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74af669a-4c2a-4ae7-805a-f2aa35a70a8d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:08.834226 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74af669a-4c2a-4ae7-805a-f2aa35a70a8d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:08.834691 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74af669a-4c2a-4ae7-805a-f2aa35a70a8d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:08.839765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-34907c11-6c63-4379-b9b7-cb6781ca368a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:08.840269 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-34907c11-6c63-4379-b9b7-cb6781ca368a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:08.841345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-34907c11-6c63-4379-b9b7-cb6781ca368a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:08.842083 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-34907c11-6c63-4379-b9b7-cb6781ca368a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:08.842591 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-34907c11-6c63-4379-b9b7-cb6781ca368a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:08.843117 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-34907c11-6c63-4379-b9b7-cb6781ca368a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:09.072628 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-34907c11-6c63-4379-b9b7-cb6781ca368a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:09.084196 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-34907c11-6c63-4379-b9b7-cb6781ca368a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.277145 Sep 01 14:59:09.085226 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 28/68] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:08 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:09.154102 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-74af669a-4c2a-4ae7-805a-f2aa35a70a8d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:09.163358 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-74af669a-4c2a-4ae7-805a-f2aa35a70a8d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.362537 Sep 01 14:59:09.171153 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 41/69] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:08 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:09.808192 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b73eab9f-967f-4f5a-882a-9f5ce7cea9e6 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:09.809700 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b73eab9f-967f-4f5a-882a-9f5ce7cea9e6 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:09.822627 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b73eab9f-967f-4f5a-882a-9f5ce7cea9e6 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:09.823296 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b73eab9f-967f-4f5a-882a-9f5ce7cea9e6 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:09.823774 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b73eab9f-967f-4f5a-882a-9f5ce7cea9e6 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:09.827256 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b73eab9f-967f-4f5a-882a-9f5ce7cea9e6 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:09.828915 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b73eab9f-967f-4f5a-882a-9f5ce7cea9e6 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:09.829382 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b73eab9f-967f-4f5a-882a-9f5ce7cea9e6 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:09.832170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:09.832806 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:09.844366 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:09.849795 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:09.851295 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:09.854734 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:09.857085 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:09.857547 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:10.067911 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:10.076604 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:10.078654 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:10.080110 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-fb60f35a-4ba9-443a-b883-0bfdf2cb17f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.253337 Sep 01 14:59:10.081122 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 42/70] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:09 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:10.164068 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-3b4b8e95-0d56-44d9-8a14-2697ea22756d req-a1404764-1b11-4d25-884a-6941614eafb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dda2c56-8fb3-4c9f-8942-9c1cf30ec182", "name": "network-vif-plugged", "status": "completed", "tag": "8f730b34-940d-4091-b2c0-79234034252e"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:10.169383 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b73eab9f-967f-4f5a-882a-9f5ce7cea9e6 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:10.179040 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b73eab9f-967f-4f5a-882a-9f5ce7cea9e6 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.374020 Sep 01 14:59:10.179969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 29/71] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:09 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:10.181976 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-3b4b8e95-0d56-44d9-8a14-2697ea22756d req-a1404764-1b11-4d25-884a-6941614eafb8 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:10.182651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-3b4b8e95-0d56-44d9-8a14-2697ea22756d req-a1404764-1b11-4d25-884a-6941614eafb8 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:10.183414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-3b4b8e95-0d56-44d9-8a14-2697ea22756d req-a1404764-1b11-4d25-884a-6941614eafb8 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:10.186358 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d49a2cc2-cdbb-438e-a45e-769c8de17ad9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:10.187306 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d49a2cc2-cdbb-438e-a45e-769c8de17ad9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:10.194670 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d49a2cc2-cdbb-438e-a45e-769c8de17ad9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:10.195226 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d49a2cc2-cdbb-438e-a45e-769c8de17ad9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:10.195679 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d49a2cc2-cdbb-438e-a45e-769c8de17ad9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:10.196395 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d49a2cc2-cdbb-438e-a45e-769c8de17ad9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:10.197015 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d49a2cc2-cdbb-438e-a45e-769c8de17ad9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:10.197580 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d49a2cc2-cdbb-438e-a45e-769c8de17ad9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:10.200067 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-3b4b8e95-0d56-44d9-8a14-2697ea22756d req-a1404764-1b11-4d25-884a-6941614eafb8 service nova] Creating event network-vif-plugged:8f730b34-940d-4091-b2c0-79234034252e for instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 on hv-cinder-85505 Sep 01 14:59:10.206838 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-3b4b8e95-0d56-44d9-8a14-2697ea22756d req-a1404764-1b11-4d25-884a-6941614eafb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123557 Sep 01 14:59:10.210009 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 43/72] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:10.223510 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=100 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:10.229985 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1e27e30e-f774-4a35-8d49-19ad475775b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:10.231421 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1e27e30e-f774-4a35-8d49-19ad475775b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:10.244347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e27e30e-f774-4a35-8d49-19ad475775b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:10.245888 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e27e30e-f774-4a35-8d49-19ad475775b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:10.246550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e27e30e-f774-4a35-8d49-19ad475775b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:10.247845 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e27e30e-f774-4a35-8d49-19ad475775b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:10.248459 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e27e30e-f774-4a35-8d49-19ad475775b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:10.249389 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e27e30e-f774-4a35-8d49-19ad475775b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:10.478753 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d49a2cc2-cdbb-438e-a45e-769c8de17ad9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:10.487016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d49a2cc2-cdbb-438e-a45e-769c8de17ad9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.305832 Sep 01 14:59:10.487644 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 30/73] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:10 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:10.557764 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1e27e30e-f774-4a35-8d49-19ad475775b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:10.563608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=100 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:10.572321 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1e27e30e-f774-4a35-8d49-19ad475775b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.347837 Sep 01 14:59:10.572872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 44/74] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:10 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:10.708686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-bb1ed43c-0ce1-43a6-aa25-69cdbed881d8 req-996356b0-5506-4f81-b251-4a04da741fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1140cc-9fea-4464-8b9b-80db1ba7afd0", "tag": "7238e964-74aa-48ea-91ba-e00ada9441ab"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:10.725998 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-bb1ed43c-0ce1-43a6-aa25-69cdbed881d8 req-996356b0-5506-4f81-b251-4a04da741fd2 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:10.726791 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-bb1ed43c-0ce1-43a6-aa25-69cdbed881d8 req-996356b0-5506-4f81-b251-4a04da741fd2 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:10.727225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-bb1ed43c-0ce1-43a6-aa25-69cdbed881d8 req-996356b0-5506-4f81-b251-4a04da741fd2 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:10.732971 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=8 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:10.756954 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-bb1ed43c-0ce1-43a6-aa25-69cdbed881d8 req-996356b0-5506-4f81-b251-4a04da741fd2 service nova] Creating event network-changed:7238e964-74aa-48ea-91ba-e00ada9441ab for instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 on hv-cinder-85505 Sep 01 14:59:10.763082 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-bb1ed43c-0ce1-43a6-aa25-69cdbed881d8 req-996356b0-5506-4f81-b251-4a04da741fd2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059153 Sep 01 14:59:10.764986 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 31/75] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:11.104300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:11.104895 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:11.111818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:11.112398 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:11.112847 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:11.113578 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:11.114066 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:11.114534 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:11.201142 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a6dad262-9d75-43fc-91c4-110b7f1b312c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:11.202442 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a6dad262-9d75-43fc-91c4-110b7f1b312c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:11.209704 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6dad262-9d75-43fc-91c4-110b7f1b312c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:11.210196 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6dad262-9d75-43fc-91c4-110b7f1b312c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:11.210716 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6dad262-9d75-43fc-91c4-110b7f1b312c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:11.211430 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6dad262-9d75-43fc-91c4-110b7f1b312c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:11.211987 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6dad262-9d75-43fc-91c4-110b7f1b312c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:11.212410 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6dad262-9d75-43fc-91c4-110b7f1b312c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:11.261397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:11.270142 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:11.271648 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:11.272778 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f49a7ba5-9130-451b-aaff-79a2a1010131 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.172374 Sep 01 14:59:11.273341 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 45/76] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:11 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:11.511919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c8de34e2-4b7c-432f-8961-5d1f51a1cd0e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:11.512455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c8de34e2-4b7c-432f-8961-5d1f51a1cd0e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:11.518614 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c8de34e2-4b7c-432f-8961-5d1f51a1cd0e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:11.519375 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c8de34e2-4b7c-432f-8961-5d1f51a1cd0e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:11.519991 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c8de34e2-4b7c-432f-8961-5d1f51a1cd0e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:11.524897 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c8de34e2-4b7c-432f-8961-5d1f51a1cd0e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:11.525571 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c8de34e2-4b7c-432f-8961-5d1f51a1cd0e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:11.526162 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c8de34e2-4b7c-432f-8961-5d1f51a1cd0e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:11.556606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a6dad262-9d75-43fc-91c4-110b7f1b312c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:11.574859 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a6dad262-9d75-43fc-91c4-110b7f1b312c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.370662 Sep 01 14:59:11.575838 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 32/77] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:11 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:11.593124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-39f9754b-f2b7-4a18-8643-f3204120bac2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:11.594083 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-39f9754b-f2b7-4a18-8643-f3204120bac2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:11.600689 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39f9754b-f2b7-4a18-8643-f3204120bac2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:11.601424 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39f9754b-f2b7-4a18-8643-f3204120bac2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:11.602025 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39f9754b-f2b7-4a18-8643-f3204120bac2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:11.602922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39f9754b-f2b7-4a18-8643-f3204120bac2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:11.603674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39f9754b-f2b7-4a18-8643-f3204120bac2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:11.604259 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39f9754b-f2b7-4a18-8643-f3204120bac2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:11.868800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-39f9754b-f2b7-4a18-8643-f3204120bac2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:11.886766 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-39f9754b-f2b7-4a18-8643-f3204120bac2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.295893 Sep 01 14:59:11.890722 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 33/78] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:11 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:12.103802 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c8de34e2-4b7c-432f-8961-5d1f51a1cd0e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:12.122037 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c8de34e2-4b7c-432f-8961-5d1f51a1cd0e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.604661 Sep 01 14:59:12.129681 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 46/79] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:11 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:12.297334 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:12.297960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:12.307607 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:12.308600 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:12.309177 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:12.311187 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:12.312631 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:12.313792 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:12.532139 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:12.544296 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:12.546148 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:12.547559 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-472cafc8-c5f8-4b5a-a69d-aa9f082d7e97 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.254239 Sep 01 14:59:12.548574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 34/80] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:12 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:12.605642 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b0576016-be72-4c33-a164-791123e0b973 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:12.606550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b0576016-be72-4c33-a164-791123e0b973 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:12.624988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0576016-be72-4c33-a164-791123e0b973 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:12.625815 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0576016-be72-4c33-a164-791123e0b973 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:12.629580 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0576016-be72-4c33-a164-791123e0b973 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:12.630468 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0576016-be72-4c33-a164-791123e0b973 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:12.631018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0576016-be72-4c33-a164-791123e0b973 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:12.631474 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0576016-be72-4c33-a164-791123e0b973 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:12.793583 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b0576016-be72-4c33-a164-791123e0b973 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:12.802913 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b0576016-be72-4c33-a164-791123e0b973 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.203177 Sep 01 14:59:12.803830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 47/81] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:12 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:12.912369 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-fd12c014-4a76-4c57-8fbd-6600ab08fecc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:12.912988 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-fd12c014-4a76-4c57-8fbd-6600ab08fecc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:12.918889 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fd12c014-4a76-4c57-8fbd-6600ab08fecc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:12.919374 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fd12c014-4a76-4c57-8fbd-6600ab08fecc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:12.919816 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fd12c014-4a76-4c57-8fbd-6600ab08fecc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:12.920512 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fd12c014-4a76-4c57-8fbd-6600ab08fecc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:12.920990 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fd12c014-4a76-4c57-8fbd-6600ab08fecc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:12.921397 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fd12c014-4a76-4c57-8fbd-6600ab08fecc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:13.072045 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-fd12c014-4a76-4c57-8fbd-6600ab08fecc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:13.080603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-fd12c014-4a76-4c57-8fbd-6600ab08fecc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.172090 Sep 01 14:59:13.091016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 35/82] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:12 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:13.135568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-3b876a26-b4fe-4825-af5f-b35f334767b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:13.136222 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-3b876a26-b4fe-4825-af5f-b35f334767b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:13.143171 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b876a26-b4fe-4825-af5f-b35f334767b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:13.144338 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b876a26-b4fe-4825-af5f-b35f334767b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:13.144877 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b876a26-b4fe-4825-af5f-b35f334767b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:13.146306 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b876a26-b4fe-4825-af5f-b35f334767b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:13.147055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b876a26-b4fe-4825-af5f-b35f334767b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:13.147598 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b876a26-b4fe-4825-af5f-b35f334767b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:13.285784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-3b876a26-b4fe-4825-af5f-b35f334767b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:13.294474 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-3b876a26-b4fe-4825-af5f-b35f334767b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.162592 Sep 01 14:59:13.295045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 48/83] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:13 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:13.578073 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:13.579648 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:13.584648 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=4 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:13.596699 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:13.598573 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:13.599181 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:13.603334 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:13.604267 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:13.605313 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:13.829836 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7d94f126-e40c-4afb-9290-acf94a7b34ee tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:13.830923 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7d94f126-e40c-4afb-9290-acf94a7b34ee tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:13.842047 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d94f126-e40c-4afb-9290-acf94a7b34ee tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:13.843571 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d94f126-e40c-4afb-9290-acf94a7b34ee tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:13.844227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d94f126-e40c-4afb-9290-acf94a7b34ee tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:13.845090 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d94f126-e40c-4afb-9290-acf94a7b34ee tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:13.845691 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d94f126-e40c-4afb-9290-acf94a7b34ee tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:13.846476 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d94f126-e40c-4afb-9290-acf94a7b34ee tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:13.856534 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:13.869718 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:13.875932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:13.877203 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-1d092a3c-e126-433e-a94a-f3ba26d3fb04 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.305894 Sep 01 14:59:13.890502 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 36/84] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:13 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:13.890502 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-04cdefb1-234b-4937-a3b5-629d45efbfca req-ec6d3a9c-eff4-4c7b-8757-f08a3e9c2553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43e2a43-72fe-4b29-81be-c508b9c9d354", "name": "network-vif-plugged", "status": "completed", "tag": "a4b9afd8-08b0-4b00-a627-9a2d62a2f5a2"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:13.904757 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-04cdefb1-234b-4937-a3b5-629d45efbfca req-ec6d3a9c-eff4-4c7b-8757-f08a3e9c2553 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:13.905301 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-04cdefb1-234b-4937-a3b5-629d45efbfca req-ec6d3a9c-eff4-4c7b-8757-f08a3e9c2553 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:13.905780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-04cdefb1-234b-4937-a3b5-629d45efbfca req-ec6d3a9c-eff4-4c7b-8757-f08a3e9c2553 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:13.950513 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-04cdefb1-234b-4937-a3b5-629d45efbfca req-ec6d3a9c-eff4-4c7b-8757-f08a3e9c2553 service nova] Creating event network-vif-plugged:a4b9afd8-08b0-4b00-a627-9a2d62a2f5a2 for instance f43e2a43-72fe-4b29-81be-c508b9c9d354 on hv-cinder-85505 Sep 01 14:59:13.957068 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-04cdefb1-234b-4937-a3b5-629d45efbfca req-ec6d3a9c-eff4-4c7b-8757-f08a3e9c2553 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076745 Sep 01 14:59:13.958393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 37/85] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:14.070626 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-7d94f126-e40c-4afb-9290-acf94a7b34ee tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:14.087373 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7d94f126-e40c-4afb-9290-acf94a7b34ee tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.265717 Sep 01 14:59:14.092487 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 49/86] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:13 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:14.117676 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7bcd7450-caf4-49e6-a669-ff251ac09750 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:14.117676 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7bcd7450-caf4-49e6-a669-ff251ac09750 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:14.137437 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7bcd7450-caf4-49e6-a669-ff251ac09750 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:14.141942 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7bcd7450-caf4-49e6-a669-ff251ac09750 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:14.143297 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7bcd7450-caf4-49e6-a669-ff251ac09750 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:14.145334 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7bcd7450-caf4-49e6-a669-ff251ac09750 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:14.145863 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7bcd7450-caf4-49e6-a669-ff251ac09750 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:14.146430 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7bcd7450-caf4-49e6-a669-ff251ac09750 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:14.316747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b8979427-0f44-4a7b-97d7-31a5318afc7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:14.317356 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b8979427-0f44-4a7b-97d7-31a5318afc7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:14.323556 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8979427-0f44-4a7b-97d7-31a5318afc7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:14.324054 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8979427-0f44-4a7b-97d7-31a5318afc7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:14.324515 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8979427-0f44-4a7b-97d7-31a5318afc7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:14.340732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7bcd7450-caf4-49e6-a669-ff251ac09750 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:14.345629 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8979427-0f44-4a7b-97d7-31a5318afc7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:14.350807 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7bcd7450-caf4-49e6-a669-ff251ac09750 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.241431 Sep 01 14:59:14.364231 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 38/87] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:14 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:14.364456 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8979427-0f44-4a7b-97d7-31a5318afc7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:14.364456 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8979427-0f44-4a7b-97d7-31a5318afc7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:14.547667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b8979427-0f44-4a7b-97d7-31a5318afc7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:14.556586 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b8979427-0f44-4a7b-97d7-31a5318afc7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.244182 Sep 01 14:59:14.568564 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 50/88] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:14 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:14.902505 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:14.903120 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:14.909068 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:14.910038 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:14.910505 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:14.911191 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:14.911642 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:14.912062 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:15.048513 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:15.057565 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:15.059030 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:15.060132 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b1381c16-73e7-4fbf-9bd4-df84831376e5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.161628 Sep 01 14:59:15.060677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 39/89] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:14 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:15.112850 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d03060c7-b719-42c8-a595-b30d1adce990 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:15.113472 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d03060c7-b719-42c8-a595-b30d1adce990 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:15.119430 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d03060c7-b719-42c8-a595-b30d1adce990 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:15.119917 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d03060c7-b719-42c8-a595-b30d1adce990 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:15.120540 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d03060c7-b719-42c8-a595-b30d1adce990 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:15.121233 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d03060c7-b719-42c8-a595-b30d1adce990 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:15.121704 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d03060c7-b719-42c8-a595-b30d1adce990 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:15.122137 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d03060c7-b719-42c8-a595-b30d1adce990 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:15.261076 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d03060c7-b719-42c8-a595-b30d1adce990 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:15.268793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d03060c7-b719-42c8-a595-b30d1adce990 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.159791 Sep 01 14:59:15.269844 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 51/90] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:15 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:15.372345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9faade37-c976-41e1-af0e-634117e1bc99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:15.373101 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9faade37-c976-41e1-af0e-634117e1bc99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:15.379784 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9faade37-c976-41e1-af0e-634117e1bc99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:15.380199 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9faade37-c976-41e1-af0e-634117e1bc99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:15.380678 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9faade37-c976-41e1-af0e-634117e1bc99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:15.381389 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9faade37-c976-41e1-af0e-634117e1bc99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:15.381890 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9faade37-c976-41e1-af0e-634117e1bc99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:15.382351 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9faade37-c976-41e1-af0e-634117e1bc99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:15.518300 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9faade37-c976-41e1-af0e-634117e1bc99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:15.526998 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9faade37-c976-41e1-af0e-634117e1bc99 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.159303 Sep 01 14:59:15.527577 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 40/91] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:15 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:15.580990 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2753ef71-a2d6-475c-82f2-6c441af9b2a2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:15.582481 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2753ef71-a2d6-475c-82f2-6c441af9b2a2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:15.588887 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2753ef71-a2d6-475c-82f2-6c441af9b2a2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:15.589368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2753ef71-a2d6-475c-82f2-6c441af9b2a2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:15.589993 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2753ef71-a2d6-475c-82f2-6c441af9b2a2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:15.590719 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2753ef71-a2d6-475c-82f2-6c441af9b2a2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:15.591174 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2753ef71-a2d6-475c-82f2-6c441af9b2a2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:15.591598 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2753ef71-a2d6-475c-82f2-6c441af9b2a2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:15.749648 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2753ef71-a2d6-475c-82f2-6c441af9b2a2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:15.757908 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2753ef71-a2d6-475c-82f2-6c441af9b2a2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.181069 Sep 01 14:59:15.759050 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 52/92] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:15 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:16.081736 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:16.082435 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:16.088558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:16.089071 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:16.089900 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:16.090828 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:16.091492 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:16.092074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:16.229963 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:16.238791 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:16.240245 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:16.241354 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-595bbbf6-efe3-47e2-ac34-db5273954b1b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.163805 Sep 01 14:59:16.241883 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 41/93] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:16 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:16.289683 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c1ffd8bd-1f69-493d-a626-be49dd74650a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:16.290374 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c1ffd8bd-1f69-493d-a626-be49dd74650a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:16.296259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c1ffd8bd-1f69-493d-a626-be49dd74650a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:16.296737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c1ffd8bd-1f69-493d-a626-be49dd74650a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:16.297180 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c1ffd8bd-1f69-493d-a626-be49dd74650a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:16.297870 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c1ffd8bd-1f69-493d-a626-be49dd74650a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:16.298357 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c1ffd8bd-1f69-493d-a626-be49dd74650a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:16.298784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c1ffd8bd-1f69-493d-a626-be49dd74650a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:16.429861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c1ffd8bd-1f69-493d-a626-be49dd74650a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:16.437875 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c1ffd8bd-1f69-493d-a626-be49dd74650a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1315 microversion: 2.1 time: 0.153038 Sep 01 14:59:16.438460 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 53/94] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:16 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:16.547831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6f952d62-b74a-41ed-a2a0-1d9347eee294 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:16.548447 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6f952d62-b74a-41ed-a2a0-1d9347eee294 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:16.555188 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f952d62-b74a-41ed-a2a0-1d9347eee294 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:16.555680 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f952d62-b74a-41ed-a2a0-1d9347eee294 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:16.556120 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f952d62-b74a-41ed-a2a0-1d9347eee294 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:16.556807 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f952d62-b74a-41ed-a2a0-1d9347eee294 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:16.557264 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f952d62-b74a-41ed-a2a0-1d9347eee294 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:16.557688 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f952d62-b74a-41ed-a2a0-1d9347eee294 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:16.710208 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6f952d62-b74a-41ed-a2a0-1d9347eee294 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:16.719467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6f952d62-b74a-41ed-a2a0-1d9347eee294 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.175349 Sep 01 14:59:16.720211 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 42/95] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:16 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:16.779129 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-96fcf93c-025f-4bfe-be7f-890a8d3e672c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:16.779795 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-96fcf93c-025f-4bfe-be7f-890a8d3e672c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:16.786800 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96fcf93c-025f-4bfe-be7f-890a8d3e672c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:16.787358 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96fcf93c-025f-4bfe-be7f-890a8d3e672c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:16.787858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96fcf93c-025f-4bfe-be7f-890a8d3e672c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:16.788745 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96fcf93c-025f-4bfe-be7f-890a8d3e672c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:16.789208 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96fcf93c-025f-4bfe-be7f-890a8d3e672c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:16.789631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96fcf93c-025f-4bfe-be7f-890a8d3e672c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:16.920178 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-96fcf93c-025f-4bfe-be7f-890a8d3e672c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:16.928623 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-96fcf93c-025f-4bfe-be7f-890a8d3e672c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.152897 Sep 01 14:59:16.934279 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 54/96] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:16 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:17.268610 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:17.270531 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:17.281437 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:17.281999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:17.282706 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:17.283613 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:17.284098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:17.284561 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:17.446428 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:17.459236 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1056b83e-7a3a-4a7f-8ab1-1a20ed378065 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:17.460131 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:17.460284 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1056b83e-7a3a-4a7f-8ab1-1a20ed378065 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:17.461688 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:17.462898 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-88ae60e8-fb09-4fb8-aeb7-16e21df1b5c7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.199678 Sep 01 14:59:17.464174 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 43/97] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:17 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:17.467084 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1056b83e-7a3a-4a7f-8ab1-1a20ed378065 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:17.467758 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1056b83e-7a3a-4a7f-8ab1-1a20ed378065 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:17.468488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1056b83e-7a3a-4a7f-8ab1-1a20ed378065 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:17.469187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1056b83e-7a3a-4a7f-8ab1-1a20ed378065 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:17.469677 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1056b83e-7a3a-4a7f-8ab1-1a20ed378065 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:17.470104 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1056b83e-7a3a-4a7f-8ab1-1a20ed378065 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:17.616716 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1056b83e-7a3a-4a7f-8ab1-1a20ed378065 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:17.624949 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1056b83e-7a3a-4a7f-8ab1-1a20ed378065 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1502 microversion: 2.1 time: 0.170350 Sep 01 14:59:17.625975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 55/98] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:17 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:17.743985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6ed675e2-9f1c-40f8-a987-d3dd718d91b3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:17.744746 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6ed675e2-9f1c-40f8-a987-d3dd718d91b3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:17.750773 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6ed675e2-9f1c-40f8-a987-d3dd718d91b3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:17.751267 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6ed675e2-9f1c-40f8-a987-d3dd718d91b3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:17.752261 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6ed675e2-9f1c-40f8-a987-d3dd718d91b3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:17.753110 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6ed675e2-9f1c-40f8-a987-d3dd718d91b3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:17.754209 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6ed675e2-9f1c-40f8-a987-d3dd718d91b3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:17.754738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6ed675e2-9f1c-40f8-a987-d3dd718d91b3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:17.923254 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6ed675e2-9f1c-40f8-a987-d3dd718d91b3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:17.931968 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6ed675e2-9f1c-40f8-a987-d3dd718d91b3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.192882 Sep 01 14:59:17.944568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 44/99] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:17 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:17.956327 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-54a8d21c-2b08-421f-a3a7-9ccd2312c16e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:17.957633 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-54a8d21c-2b08-421f-a3a7-9ccd2312c16e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:17.965667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54a8d21c-2b08-421f-a3a7-9ccd2312c16e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:17.966335 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54a8d21c-2b08-421f-a3a7-9ccd2312c16e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:17.966777 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54a8d21c-2b08-421f-a3a7-9ccd2312c16e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:17.967660 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54a8d21c-2b08-421f-a3a7-9ccd2312c16e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:17.968123 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54a8d21c-2b08-421f-a3a7-9ccd2312c16e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:17.968553 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54a8d21c-2b08-421f-a3a7-9ccd2312c16e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:18.138252 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-54a8d21c-2b08-421f-a3a7-9ccd2312c16e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:18.151150 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-54a8d21c-2b08-421f-a3a7-9ccd2312c16e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.199469 Sep 01 14:59:18.154487 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 56/100] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:17 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:18.489900 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:18.490675 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:18.496752 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:18.497186 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:18.497630 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:18.498405 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:18.498871 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:18.499301 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:18.634780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:18.642777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:18.644255 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:18.645374 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-8b9d3303-93ce-4823-8479-1208e8a2e269 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.159920 Sep 01 14:59:18.645962 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 45/101] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:18 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:18.954686 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a7db3585-7bcd-4ef5-a343-ffd179db5c81 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:18.955651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a7db3585-7bcd-4ef5-a343-ffd179db5c81 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:18.970079 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7db3585-7bcd-4ef5-a343-ffd179db5c81 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:18.971400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7db3585-7bcd-4ef5-a343-ffd179db5c81 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:18.972179 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7db3585-7bcd-4ef5-a343-ffd179db5c81 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:18.973094 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7db3585-7bcd-4ef5-a343-ffd179db5c81 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:18.973774 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7db3585-7bcd-4ef5-a343-ffd179db5c81 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:18.974548 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7db3585-7bcd-4ef5-a343-ffd179db5c81 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:19.121366 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-966a21ae-95bf-424a-b20a-6ad9794d9fa2 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e15d2db-72ea-4323-9ef0-e760b406a75f"}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:19.125056 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-966a21ae-95bf-424a-b20a-6ad9794d9fa2 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:19.131746 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966a21ae-95bf-424a-b20a-6ad9794d9fa2 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:19.132498 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966a21ae-95bf-424a-b20a-6ad9794d9fa2 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:19.132942 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966a21ae-95bf-424a-b20a-6ad9794d9fa2 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:19.133651 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966a21ae-95bf-424a-b20a-6ad9794d9fa2 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:19.134110 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966a21ae-95bf-424a-b20a-6ad9794d9fa2 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:19.134825 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966a21ae-95bf-424a-b20a-6ad9794d9fa2 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:19.153622 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a7db3585-7bcd-4ef5-a343-ffd179db5c81 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:19.162736 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a7db3585-7bcd-4ef5-a343-ffd179db5c81 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1321 microversion: 2.1 time: 0.212131 Sep 01 14:59:19.163699 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 57/102] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:18 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:19.181606 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-99c3c1f1-6ad6-4768-b738-7bc11578fd07 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:19.182505 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-99c3c1f1-6ad6-4768-b738-7bc11578fd07 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:19.189459 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-99c3c1f1-6ad6-4768-b738-7bc11578fd07 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:19.189849 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-99c3c1f1-6ad6-4768-b738-7bc11578fd07 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:19.190311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-99c3c1f1-6ad6-4768-b738-7bc11578fd07 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:19.191790 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-99c3c1f1-6ad6-4768-b738-7bc11578fd07 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:19.192433 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-99c3c1f1-6ad6-4768-b738-7bc11578fd07 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:19.193050 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-99c3c1f1-6ad6-4768-b738-7bc11578fd07 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:19.368988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-99c3c1f1-6ad6-4768-b738-7bc11578fd07 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:19.379260 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-99c3c1f1-6ad6-4768-b738-7bc11578fd07 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.200684 Sep 01 14:59:19.380212 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 58/103] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:19 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:19.396311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-ab550a6a-4073-4600-9c35-eb397dc8663e req-05210dac-e3c6-4410-bc0b-ee9f916ef8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7322e2bb-f39f-46ee-9193-1edd605d833f", "name": "network-vif-plugged", "status": "completed", "tag": "15dcee05-385b-4dbf-9d4a-1e83e723059e"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:19.418676 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-ab550a6a-4073-4600-9c35-eb397dc8663e req-05210dac-e3c6-4410-bc0b-ee9f916ef8cb service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:19.422651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-ab550a6a-4073-4600-9c35-eb397dc8663e req-05210dac-e3c6-4410-bc0b-ee9f916ef8cb service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:19.423371 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-ab550a6a-4073-4600-9c35-eb397dc8663e req-05210dac-e3c6-4410-bc0b-ee9f916ef8cb service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:19.448584 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-ab550a6a-4073-4600-9c35-eb397dc8663e req-05210dac-e3c6-4410-bc0b-ee9f916ef8cb service nova] Creating event network-vif-plugged:15dcee05-385b-4dbf-9d4a-1e83e723059e for instance 7322e2bb-f39f-46ee-9193-1edd605d833f on hv-cinder-85505 Sep 01 14:59:19.459743 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-ab550a6a-4073-4600-9c35-eb397dc8663e req-05210dac-e3c6-4410-bc0b-ee9f916ef8cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078037 Sep 01 14:59:19.460875 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 59/104] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:19.613741 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-966a21ae-95bf-424a-b20a-6ad9794d9fa2 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "POST /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.495422 Sep 01 14:59:19.614687 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 46/105] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 14:59:19 2022] POST /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:19.669730 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:19.670636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:19.699664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:19.699664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:19.700126 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:19.701376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:19.702059 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:19.702719 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:19.889089 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:19.899423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:19.901126 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:19.902283 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a652e9cd-407a-48ec-af87-617a33c1fd95 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.237721 Sep 01 14:59:19.902869 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 60/106] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:19 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:20.184047 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a1ebbcbe-351c-49ea-9e6e-ceb62add2c0a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:20.184809 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a1ebbcbe-351c-49ea-9e6e-ceb62add2c0a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:20.191663 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1ebbcbe-351c-49ea-9e6e-ceb62add2c0a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:20.192230 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1ebbcbe-351c-49ea-9e6e-ceb62add2c0a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:20.192680 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1ebbcbe-351c-49ea-9e6e-ceb62add2c0a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:20.193378 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1ebbcbe-351c-49ea-9e6e-ceb62add2c0a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:20.193840 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1ebbcbe-351c-49ea-9e6e-ceb62add2c0a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:20.194335 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1ebbcbe-351c-49ea-9e6e-ceb62add2c0a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:20.199752 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:20.366989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a1ebbcbe-351c-49ea-9e6e-ceb62add2c0a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:20.375195 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a1ebbcbe-351c-49ea-9e6e-ceb62add2c0a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1515 microversion: 2.1 time: 0.195561 Sep 01 14:59:20.375751 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 47/107] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:20 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:20.396637 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a55b834c-7a45-4c5a-aa63-5d84e4817a26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:20.399129 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a55b834c-7a45-4c5a-aa63-5d84e4817a26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:20.404364 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-309409db-bbbf-4e0c-83ee-59fdef8e6bd5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:20.404978 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-309409db-bbbf-4e0c-83ee-59fdef8e6bd5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:20.413572 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-309409db-bbbf-4e0c-83ee-59fdef8e6bd5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:20.414127 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-309409db-bbbf-4e0c-83ee-59fdef8e6bd5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:20.414605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-309409db-bbbf-4e0c-83ee-59fdef8e6bd5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:20.415315 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-309409db-bbbf-4e0c-83ee-59fdef8e6bd5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:20.415785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-309409db-bbbf-4e0c-83ee-59fdef8e6bd5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:20.416209 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-309409db-bbbf-4e0c-83ee-59fdef8e6bd5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:20.425704 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a55b834c-7a45-4c5a-aa63-5d84e4817a26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:20.426367 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a55b834c-7a45-4c5a-aa63-5d84e4817a26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:20.426988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a55b834c-7a45-4c5a-aa63-5d84e4817a26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:20.428501 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a55b834c-7a45-4c5a-aa63-5d84e4817a26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:20.429742 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a55b834c-7a45-4c5a-aa63-5d84e4817a26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:20.430511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a55b834c-7a45-4c5a-aa63-5d84e4817a26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:20.503523 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-a55b834c-7a45-4c5a-aa63-5d84e4817a26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lazy-loading 'flavor' on Instance uuid f43e2a43-72fe-4b29-81be-c508b9c9d354 {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:59:20.566650 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=100 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:20.591044 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-309409db-bbbf-4e0c-83ee-59fdef8e6bd5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:20.600304 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-309409db-bbbf-4e0c-83ee-59fdef8e6bd5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.199581 Sep 01 14:59:20.601404 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 48/108] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:20 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:20.669241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a55b834c-7a45-4c5a-aa63-5d84e4817a26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "POST /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354/action" status: 200 len: 32 microversion: 2.1 time: 0.277055 Sep 01 14:59:20.669836 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 61/109] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 14:59:20 2022] POST /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:59:20.680267 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ad75f8a1-06b9-4ddc-b2b3-2a8f86357e20 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:20.680932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ad75f8a1-06b9-4ddc-b2b3-2a8f86357e20 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:20.686846 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ad75f8a1-06b9-4ddc-b2b3-2a8f86357e20 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:20.687329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ad75f8a1-06b9-4ddc-b2b3-2a8f86357e20 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:20.687763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ad75f8a1-06b9-4ddc-b2b3-2a8f86357e20 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:20.688448 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ad75f8a1-06b9-4ddc-b2b3-2a8f86357e20 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:20.688930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ad75f8a1-06b9-4ddc-b2b3-2a8f86357e20 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:20.689298 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ad75f8a1-06b9-4ddc-b2b3-2a8f86357e20 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:20.840415 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ad75f8a1-06b9-4ddc-b2b3-2a8f86357e20 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:20.849216 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ad75f8a1-06b9-4ddc-b2b3-2a8f86357e20 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.172971 Sep 01 14:59:20.849903 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 49/110] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:20 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:20.926489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:20.927466 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:20.947348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:20.948017 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:20.948797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:20.949672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:20.950303 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:20.951031 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:21.200118 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:21.215659 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:21.219152 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:21.221311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-27f0dab7-8cd4-4f9a-b342-3afc4f1c8a84 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.299889 Sep 01 14:59:21.222327 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 62/111] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:20 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:21.479751 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-b81b7772-c78b-4086-a0c3-8510d6798c9e req-986bee1f-2aca-4894-a327-536dbb3b9219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2570eed9-40bd-40ef-92d6-63b4e3cc83bf", "name": "network-vif-plugged", "status": "completed", "tag": "2edcc91b-b083-48b1-bb53-84caae283791"}, {"server_uuid": "2c1140cc-9fea-4464-8b9b-80db1ba7afd0", "name": "network-vif-plugged", "status": "completed", "tag": "7238e964-74aa-48ea-91ba-e00ada9441ab"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:21.492102 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b81b7772-c78b-4086-a0c3-8510d6798c9e req-986bee1f-2aca-4894-a327-536dbb3b9219 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:21.492688 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b81b7772-c78b-4086-a0c3-8510d6798c9e req-986bee1f-2aca-4894-a327-536dbb3b9219 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:21.493276 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b81b7772-c78b-4086-a0c3-8510d6798c9e req-986bee1f-2aca-4894-a327-536dbb3b9219 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:21.508035 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-b81b7772-c78b-4086-a0c3-8510d6798c9e req-986bee1f-2aca-4894-a327-536dbb3b9219 service nova] Creating event network-vif-plugged:2edcc91b-b083-48b1-bb53-84caae283791 for instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf on hv-cinder-85505 Sep 01 14:59:21.508782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-b81b7772-c78b-4086-a0c3-8510d6798c9e req-986bee1f-2aca-4894-a327-536dbb3b9219 service nova] Creating event network-vif-plugged:7238e964-74aa-48ea-91ba-e00ada9441ab for instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 on hv-cinder-85505 Sep 01 14:59:21.516201 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-b81b7772-c78b-4086-a0c3-8510d6798c9e req-986bee1f-2aca-4894-a327-536dbb3b9219 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040985 Sep 01 14:59:21.517051 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 50/112] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:21.621364 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1458aef7-5c6b-4bbb-9cea-c2e1c9fa5220 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:21.622997 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1458aef7-5c6b-4bbb-9cea-c2e1c9fa5220 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:21.630928 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1458aef7-5c6b-4bbb-9cea-c2e1c9fa5220 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:21.631758 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1458aef7-5c6b-4bbb-9cea-c2e1c9fa5220 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:21.632783 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1458aef7-5c6b-4bbb-9cea-c2e1c9fa5220 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:21.633689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1458aef7-5c6b-4bbb-9cea-c2e1c9fa5220 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:21.634166 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1458aef7-5c6b-4bbb-9cea-c2e1c9fa5220 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:21.634513 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1458aef7-5c6b-4bbb-9cea-c2e1c9fa5220 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:21.833735 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1458aef7-5c6b-4bbb-9cea-c2e1c9fa5220 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:21.846837 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1458aef7-5c6b-4bbb-9cea-c2e1c9fa5220 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.229577 Sep 01 14:59:21.848101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 63/113] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:21 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:21.874576 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2cc12df2-d8d8-44f7-b897-df2f16db0060 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:21.875287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2cc12df2-d8d8-44f7-b897-df2f16db0060 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:21.890361 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cc12df2-d8d8-44f7-b897-df2f16db0060 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:21.890882 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cc12df2-d8d8-44f7-b897-df2f16db0060 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:21.891333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cc12df2-d8d8-44f7-b897-df2f16db0060 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:21.892170 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cc12df2-d8d8-44f7-b897-df2f16db0060 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:21.892811 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cc12df2-d8d8-44f7-b897-df2f16db0060 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:21.894102 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cc12df2-d8d8-44f7-b897-df2f16db0060 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:22.238475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2cc12df2-d8d8-44f7-b897-df2f16db0060 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:22.244505 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:22.245354 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:22.247072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2cc12df2-d8d8-44f7-b897-df2f16db0060 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.376917 Sep 01 14:59:22.247810 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 51/114] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:21 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:22.265247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:22.266432 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:22.266881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:22.267593 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:22.268061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:22.270402 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:22.435761 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:22.444616 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:22.446106 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:22.451177 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-14e6a676-2d3b-4b3d-b6e5-2d41299ad5ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.206626 Sep 01 14:59:22.451771 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 64/115] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:22 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:59:22.868612 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-51855cce-a469-4db5-8ea2-92c763a088e5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:22.869624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-51855cce-a469-4db5-8ea2-92c763a088e5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:22.876473 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-51855cce-a469-4db5-8ea2-92c763a088e5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:22.877637 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-51855cce-a469-4db5-8ea2-92c763a088e5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:22.878413 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-51855cce-a469-4db5-8ea2-92c763a088e5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:22.879993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-51855cce-a469-4db5-8ea2-92c763a088e5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:22.880889 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-51855cce-a469-4db5-8ea2-92c763a088e5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:22.881471 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-51855cce-a469-4db5-8ea2-92c763a088e5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:23.105725 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-51855cce-a469-4db5-8ea2-92c763a088e5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:23.113612 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-51855cce-a469-4db5-8ea2-92c763a088e5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1363 microversion: 2.1 time: 0.248662 Sep 01 14:59:23.114179 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 52/116] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:22 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:23.267660 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ce8b9440-e792-478f-b71f-3ab98800b2ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:23.268278 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ce8b9440-e792-478f-b71f-3ab98800b2ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:23.274757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce8b9440-e792-478f-b71f-3ab98800b2ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:23.275240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce8b9440-e792-478f-b71f-3ab98800b2ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:23.275671 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce8b9440-e792-478f-b71f-3ab98800b2ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:23.276353 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce8b9440-e792-478f-b71f-3ab98800b2ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:23.276804 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce8b9440-e792-478f-b71f-3ab98800b2ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:23.277572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce8b9440-e792-478f-b71f-3ab98800b2ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:23.420088 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ce8b9440-e792-478f-b71f-3ab98800b2ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:23.429210 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ce8b9440-e792-478f-b71f-3ab98800b2ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.165379 Sep 01 14:59:23.429778 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 65/117] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:23 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:23.477602 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:23.478516 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:23.484734 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:23.485232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:23.485671 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:23.486454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:23.487047 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:23.487952 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:23.700000 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:23.709377 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:23.711544 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:23.712679 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4ed0f268-46be-4cb2-9263-5517ef4973f8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1405 microversion: 2.20 time: 0.239068 Sep 01 14:59:23.713394 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 53/118] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:23 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:59:24.139515 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-315ed264-a3bf-4d86-949b-c3f1fecd6860 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:24.140414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-315ed264-a3bf-4d86-949b-c3f1fecd6860 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:24.149189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-315ed264-a3bf-4d86-949b-c3f1fecd6860 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:24.149919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-315ed264-a3bf-4d86-949b-c3f1fecd6860 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:24.150465 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-315ed264-a3bf-4d86-949b-c3f1fecd6860 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:24.151289 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-315ed264-a3bf-4d86-949b-c3f1fecd6860 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:24.151748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-315ed264-a3bf-4d86-949b-c3f1fecd6860 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:24.152395 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-315ed264-a3bf-4d86-949b-c3f1fecd6860 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:24.347292 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-315ed264-a3bf-4d86-949b-c3f1fecd6860 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:24.356662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-315ed264-a3bf-4d86-949b-c3f1fecd6860 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1550 microversion: 2.1 time: 0.221833 Sep 01 14:59:24.357804 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 66/119] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:24 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1550 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:24.379486 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0d22a280-6654-48e9-a988-a458a971dc91 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:24.380098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0d22a280-6654-48e9-a988-a458a971dc91 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:24.387394 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d22a280-6654-48e9-a988-a458a971dc91 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:24.388105 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d22a280-6654-48e9-a988-a458a971dc91 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:24.388705 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d22a280-6654-48e9-a988-a458a971dc91 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:24.389406 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d22a280-6654-48e9-a988-a458a971dc91 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:24.389859 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d22a280-6654-48e9-a988-a458a971dc91 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:24.390475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d22a280-6654-48e9-a988-a458a971dc91 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:24.452981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9cb62f09-96cb-4433-ba15-235f1c900308 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:24.453663 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9cb62f09-96cb-4433-ba15-235f1c900308 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:24.465393 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cb62f09-96cb-4433-ba15-235f1c900308 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:24.465889 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cb62f09-96cb-4433-ba15-235f1c900308 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:24.466370 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cb62f09-96cb-4433-ba15-235f1c900308 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:24.467101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cb62f09-96cb-4433-ba15-235f1c900308 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:24.468120 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cb62f09-96cb-4433-ba15-235f1c900308 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:24.468558 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cb62f09-96cb-4433-ba15-235f1c900308 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:24.486830 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0d22a280-6654-48e9-a988-a458a971dc91 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112241 Sep 01 14:59:24.488045 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 54/120] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 1 14:59:24 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:24.733812 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:24.734461 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:24.741189 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:24.741673 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:24.742109 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:24.742836 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:24.743288 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:24.743713 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:24.788910 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9cb62f09-96cb-4433-ba15-235f1c900308 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:24.797449 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9cb62f09-96cb-4433-ba15-235f1c900308 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.348286 Sep 01 14:59:24.798026 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 67/121] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:24 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:24.878896 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:24.887613 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:24.889056 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:24.890220 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4fc6b663-07dd-4e43-9ca9-2bea52a0b650 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1598 microversion: 2.20 time: 0.160315 Sep 01 14:59:24.890958 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 55/122] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 14:59:24 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:59:24.913419 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-76cce294-a556-4d94-9998-8dc8b7638657 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:24.913843 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-76cce294-a556-4d94-9998-8dc8b7638657 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:24.919729 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76cce294-a556-4d94-9998-8dc8b7638657 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:24.920214 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76cce294-a556-4d94-9998-8dc8b7638657 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:24.920655 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76cce294-a556-4d94-9998-8dc8b7638657 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:24.921340 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76cce294-a556-4d94-9998-8dc8b7638657 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:24.921796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76cce294-a556-4d94-9998-8dc8b7638657 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:24.922227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76cce294-a556-4d94-9998-8dc8b7638657 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:25.076223 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-76cce294-a556-4d94-9998-8dc8b7638657 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.167243 Sep 01 14:59:25.076926 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 68/123] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Sep 1 14:59:24 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:59:25.820192 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-18e581c0-709f-4d49-8b23-a03851ceb461 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:25.820795 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-18e581c0-709f-4d49-8b23-a03851ceb461 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:25.832036 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18e581c0-709f-4d49-8b23-a03851ceb461 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:25.832526 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18e581c0-709f-4d49-8b23-a03851ceb461 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:25.832963 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18e581c0-709f-4d49-8b23-a03851ceb461 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:25.842174 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18e581c0-709f-4d49-8b23-a03851ceb461 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:25.842883 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18e581c0-709f-4d49-8b23-a03851ceb461 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:25.843177 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18e581c0-709f-4d49-8b23-a03851ceb461 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:26.091874 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-a3851ef8-8fef-4539-87ec-e9f8a08ee471 req-78e3c9f4-5af8-4c1b-9dc3-056b097a3f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1140cc-9fea-4464-8b9b-80db1ba7afd0", "tag": "7238e964-74aa-48ea-91ba-e00ada9441ab"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:26.103890 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-a3851ef8-8fef-4539-87ec-e9f8a08ee471 req-78e3c9f4-5af8-4c1b-9dc3-056b097a3f08 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:26.104638 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-a3851ef8-8fef-4539-87ec-e9f8a08ee471 req-78e3c9f4-5af8-4c1b-9dc3-056b097a3f08 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:26.105173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-a3851ef8-8fef-4539-87ec-e9f8a08ee471 req-78e3c9f4-5af8-4c1b-9dc3-056b097a3f08 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:26.118992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-a3851ef8-8fef-4539-87ec-e9f8a08ee471 req-78e3c9f4-5af8-4c1b-9dc3-056b097a3f08 service nova] Creating event network-changed:7238e964-74aa-48ea-91ba-e00ada9441ab for instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 on hv-cinder-85505 Sep 01 14:59:26.124745 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-a3851ef8-8fef-4539-87ec-e9f8a08ee471 req-78e3c9f4-5af8-4c1b-9dc3-056b097a3f08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037004 Sep 01 14:59:26.125512 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 69/124] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:59:26.260195 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-18e581c0-709f-4d49-8b23-a03851ceb461 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:26.268368 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-18e581c0-709f-4d49-8b23-a03851ceb461 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.453243 Sep 01 14:59:26.269048 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 56/125] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:25 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:26.632116 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-116e2cb4-e0ef-4e0c-9fe6-4a0fbfbc9f77 req-13cb0606-137f-40ff-9846-487cd349f9bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2570eed9-40bd-40ef-92d6-63b4e3cc83bf", "tag": "2edcc91b-b083-48b1-bb53-84caae283791"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:26.642743 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-116e2cb4-e0ef-4e0c-9fe6-4a0fbfbc9f77 req-13cb0606-137f-40ff-9846-487cd349f9bc service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:26.643221 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-116e2cb4-e0ef-4e0c-9fe6-4a0fbfbc9f77 req-13cb0606-137f-40ff-9846-487cd349f9bc service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:26.644419 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-116e2cb4-e0ef-4e0c-9fe6-4a0fbfbc9f77 req-13cb0606-137f-40ff-9846-487cd349f9bc service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:26.655760 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-116e2cb4-e0ef-4e0c-9fe6-4a0fbfbc9f77 req-13cb0606-137f-40ff-9846-487cd349f9bc service nova] Creating event network-changed:2edcc91b-b083-48b1-bb53-84caae283791 for instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf on hv-cinder-85505 Sep 01 14:59:26.661753 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-116e2cb4-e0ef-4e0c-9fe6-4a0fbfbc9f77 req-13cb0606-137f-40ff-9846-487cd349f9bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033899 Sep 01 14:59:26.662658 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 70/126] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:59:27.293873 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c7c856e6-b2e9-4592-b62f-a44d87a268f5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:27.295115 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c7c856e6-b2e9-4592-b62f-a44d87a268f5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:27.303413 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7c856e6-b2e9-4592-b62f-a44d87a268f5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:27.304129 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7c856e6-b2e9-4592-b62f-a44d87a268f5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:27.304719 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7c856e6-b2e9-4592-b62f-a44d87a268f5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:27.305568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7c856e6-b2e9-4592-b62f-a44d87a268f5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:27.306350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7c856e6-b2e9-4592-b62f-a44d87a268f5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:27.307132 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7c856e6-b2e9-4592-b62f-a44d87a268f5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:27.455544 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c7c856e6-b2e9-4592-b62f-a44d87a268f5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:27.469867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c7c856e6-b2e9-4592-b62f-a44d87a268f5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.182698 Sep 01 14:59:27.470605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 57/127] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:27 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:28.492727 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-326e9c26-7e6e-4646-b6e5-6e8e1bb029bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:28.493432 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-326e9c26-7e6e-4646-b6e5-6e8e1bb029bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:28.499522 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-326e9c26-7e6e-4646-b6e5-6e8e1bb029bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:28.499941 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-326e9c26-7e6e-4646-b6e5-6e8e1bb029bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:28.500386 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-326e9c26-7e6e-4646-b6e5-6e8e1bb029bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:28.501087 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-326e9c26-7e6e-4646-b6e5-6e8e1bb029bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:28.501546 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-326e9c26-7e6e-4646-b6e5-6e8e1bb029bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:28.501978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-326e9c26-7e6e-4646-b6e5-6e8e1bb029bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:28.653514 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-326e9c26-7e6e-4646-b6e5-6e8e1bb029bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:28.662384 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-326e9c26-7e6e-4646-b6e5-6e8e1bb029bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.173928 Sep 01 14:59:28.662953 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 71/128] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:28 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:29.683904 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b071abd1-ba7e-4cf3-95de-a46232bcbe39 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:29.685320 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b071abd1-ba7e-4cf3-95de-a46232bcbe39 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:29.697739 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b071abd1-ba7e-4cf3-95de-a46232bcbe39 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:29.698765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b071abd1-ba7e-4cf3-95de-a46232bcbe39 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:29.698931 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b071abd1-ba7e-4cf3-95de-a46232bcbe39 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:29.699877 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b071abd1-ba7e-4cf3-95de-a46232bcbe39 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:29.701734 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b071abd1-ba7e-4cf3-95de-a46232bcbe39 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:29.702455 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b071abd1-ba7e-4cf3-95de-a46232bcbe39 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:29.854542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b071abd1-ba7e-4cf3-95de-a46232bcbe39 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:29.863004 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b071abd1-ba7e-4cf3-95de-a46232bcbe39 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.183028 Sep 01 14:59:29.864348 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 58/129] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:29 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:30.884573 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5e6d6800-5b79-4451-bd1a-ca2363fcb429 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:30.885190 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5e6d6800-5b79-4451-bd1a-ca2363fcb429 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:30.891283 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e6d6800-5b79-4451-bd1a-ca2363fcb429 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:30.891696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e6d6800-5b79-4451-bd1a-ca2363fcb429 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:30.892131 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e6d6800-5b79-4451-bd1a-ca2363fcb429 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:30.892817 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e6d6800-5b79-4451-bd1a-ca2363fcb429 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:30.893797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e6d6800-5b79-4451-bd1a-ca2363fcb429 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:30.894220 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e6d6800-5b79-4451-bd1a-ca2363fcb429 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:31.027709 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-5e6d6800-5b79-4451-bd1a-ca2363fcb429 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:31.036002 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5e6d6800-5b79-4451-bd1a-ca2363fcb429 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.155186 Sep 01 14:59:31.036884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 72/130] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:30 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:32.070415 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c2c122f6-983f-4eb6-8bce-0c24df586a5b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:32.071885 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c2c122f6-983f-4eb6-8bce-0c24df586a5b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:32.078932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2c122f6-983f-4eb6-8bce-0c24df586a5b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:32.079638 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2c122f6-983f-4eb6-8bce-0c24df586a5b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:32.080088 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2c122f6-983f-4eb6-8bce-0c24df586a5b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:32.080796 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2c122f6-983f-4eb6-8bce-0c24df586a5b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:32.081579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2c122f6-983f-4eb6-8bce-0c24df586a5b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:32.082015 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2c122f6-983f-4eb6-8bce-0c24df586a5b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:32.214775 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c2c122f6-983f-4eb6-8bce-0c24df586a5b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:32.223672 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c2c122f6-983f-4eb6-8bce-0c24df586a5b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.157039 Sep 01 14:59:32.224227 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 59/131] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:32 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:33.245179 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cb479fd8-efdc-4e68-8d02-2dfa68466084 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:33.246372 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-cb479fd8-efdc-4e68-8d02-2dfa68466084 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:33.248901 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=89 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:33.256429 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb479fd8-efdc-4e68-8d02-2dfa68466084 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:33.256918 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb479fd8-efdc-4e68-8d02-2dfa68466084 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:33.257352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb479fd8-efdc-4e68-8d02-2dfa68466084 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:33.258047 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb479fd8-efdc-4e68-8d02-2dfa68466084 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:33.258672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb479fd8-efdc-4e68-8d02-2dfa68466084 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:33.259241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb479fd8-efdc-4e68-8d02-2dfa68466084 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:33.548748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-cb479fd8-efdc-4e68-8d02-2dfa68466084 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:33.557404 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cb479fd8-efdc-4e68-8d02-2dfa68466084 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.316786 Sep 01 14:59:33.557977 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 73/132] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:33 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:33.836342 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5af90285-128e-43fb-9b11-deeab8457fcb tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:33.837650 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5af90285-128e-43fb-9b11-deeab8457fcb tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:33.847515 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af90285-128e-43fb-9b11-deeab8457fcb tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:33.848101 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af90285-128e-43fb-9b11-deeab8457fcb tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:33.848797 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af90285-128e-43fb-9b11-deeab8457fcb tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:33.849597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af90285-128e-43fb-9b11-deeab8457fcb tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:33.850397 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af90285-128e-43fb-9b11-deeab8457fcb tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:33.851023 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af90285-128e-43fb-9b11-deeab8457fcb tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:33.896886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5af90285-128e-43fb-9b11-deeab8457fcb tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:59:34.008398 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5af90285-128e-43fb-9b11-deeab8457fcb tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 204 len: 0 microversion: 2.1 time: 0.184021 Sep 01 14:59:34.008968 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 60/133] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 14:59:33 2022] DELETE /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:59:34.017442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4620cbb4-5340-4d32-b228-6aa3819cfb36 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:34.018773 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4620cbb4-5340-4d32-b228-6aa3819cfb36 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:34.025634 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4620cbb4-5340-4d32-b228-6aa3819cfb36 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:34.026141 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4620cbb4-5340-4d32-b228-6aa3819cfb36 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:34.026604 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4620cbb4-5340-4d32-b228-6aa3819cfb36 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:34.027296 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4620cbb4-5340-4d32-b228-6aa3819cfb36 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:34.027746 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4620cbb4-5340-4d32-b228-6aa3819cfb36 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:34.028175 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4620cbb4-5340-4d32-b228-6aa3819cfb36 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:34.165658 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4620cbb4-5340-4d32-b228-6aa3819cfb36 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:34.174665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4620cbb4-5340-4d32-b228-6aa3819cfb36 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1554 microversion: 2.1 time: 0.161458 Sep 01 14:59:34.175261 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 74/134] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:34 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:34.578331 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a41f099d-497c-444f-8d9f-df38b37a0da4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:34.579021 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a41f099d-497c-444f-8d9f-df38b37a0da4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:34.584894 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a41f099d-497c-444f-8d9f-df38b37a0da4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:34.585370 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a41f099d-497c-444f-8d9f-df38b37a0da4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:34.585800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a41f099d-497c-444f-8d9f-df38b37a0da4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:34.586503 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a41f099d-497c-444f-8d9f-df38b37a0da4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:34.586960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a41f099d-497c-444f-8d9f-df38b37a0da4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:34.587380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a41f099d-497c-444f-8d9f-df38b37a0da4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:34.721023 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a41f099d-497c-444f-8d9f-df38b37a0da4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:34.729082 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a41f099d-497c-444f-8d9f-df38b37a0da4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.155023 Sep 01 14:59:34.729641 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 61/135] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:34 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:35.198470 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-94b7916b-6cf8-4f8f-9e24-e22fb4949db1 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:35.199216 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-94b7916b-6cf8-4f8f-9e24-e22fb4949db1 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:35.205594 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-94b7916b-6cf8-4f8f-9e24-e22fb4949db1 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:35.206174 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-94b7916b-6cf8-4f8f-9e24-e22fb4949db1 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:35.206937 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-94b7916b-6cf8-4f8f-9e24-e22fb4949db1 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:35.207656 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-94b7916b-6cf8-4f8f-9e24-e22fb4949db1 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:35.208109 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-94b7916b-6cf8-4f8f-9e24-e22fb4949db1 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:35.208703 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-94b7916b-6cf8-4f8f-9e24-e22fb4949db1 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:35.354726 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-94b7916b-6cf8-4f8f-9e24-e22fb4949db1 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:35.363572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-94b7916b-6cf8-4f8f-9e24-e22fb4949db1 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1554 microversion: 2.1 time: 0.169326 Sep 01 14:59:35.364581 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 75/136] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:35 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:35.751895 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-fe62f328-9495-4273-acb1-ead0a0c2b358 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:35.754814 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-fe62f328-9495-4273-acb1-ead0a0c2b358 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:35.763589 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe62f328-9495-4273-acb1-ead0a0c2b358 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:35.764252 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe62f328-9495-4273-acb1-ead0a0c2b358 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:35.764871 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe62f328-9495-4273-acb1-ead0a0c2b358 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:35.765606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe62f328-9495-4273-acb1-ead0a0c2b358 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:35.766066 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe62f328-9495-4273-acb1-ead0a0c2b358 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:35.766959 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe62f328-9495-4273-acb1-ead0a0c2b358 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:35.935057 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-fe62f328-9495-4273-acb1-ead0a0c2b358 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:35.943847 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-fe62f328-9495-4273-acb1-ead0a0c2b358 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.197014 Sep 01 14:59:35.944423 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 62/137] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:35 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:36.385206 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bc48eda5-cd22-49b7-8b15-9f7688b98ff4 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:36.386551 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-bc48eda5-cd22-49b7-8b15-9f7688b98ff4 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:36.392841 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc48eda5-cd22-49b7-8b15-9f7688b98ff4 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:36.393626 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc48eda5-cd22-49b7-8b15-9f7688b98ff4 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:36.394061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc48eda5-cd22-49b7-8b15-9f7688b98ff4 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:36.395117 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc48eda5-cd22-49b7-8b15-9f7688b98ff4 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:36.396311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc48eda5-cd22-49b7-8b15-9f7688b98ff4 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:36.396731 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc48eda5-cd22-49b7-8b15-9f7688b98ff4 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:36.897904 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-bc48eda5-cd22-49b7-8b15-9f7688b98ff4 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:36.912643 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-bc48eda5-cd22-49b7-8b15-9f7688b98ff4 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1554 microversion: 2.1 time: 0.531050 Sep 01 14:59:36.914502 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 76/138] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:36 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1554 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:36.968394 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e7fea24d-328f-4ceb-9996-ac05ca99d4ea tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:36.971997 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e7fea24d-328f-4ceb-9996-ac05ca99d4ea tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:36.984740 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7fea24d-328f-4ceb-9996-ac05ca99d4ea tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:36.985929 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7fea24d-328f-4ceb-9996-ac05ca99d4ea tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:36.986955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7fea24d-328f-4ceb-9996-ac05ca99d4ea tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:36.988629 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7fea24d-328f-4ceb-9996-ac05ca99d4ea tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:36.989437 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7fea24d-328f-4ceb-9996-ac05ca99d4ea tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:36.990634 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7fea24d-328f-4ceb-9996-ac05ca99d4ea tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:36.996982 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:37.220842 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e7fea24d-328f-4ceb-9996-ac05ca99d4ea tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:37.232860 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e7fea24d-328f-4ceb-9996-ac05ca99d4ea tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.271165 Sep 01 14:59:37.234643 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 63/139] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:36 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:37.493427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-abecca84-0d00-43ee-a034-f0f28a7e908e req-0b3e781d-3db3-4934-a552-43ef13f8c3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dda2c56-8fb3-4c9f-8942-9c1cf30ec182", "name": "network-vif-deleted", "tag": "8f730b34-940d-4091-b2c0-79234034252e"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:37.512575 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-abecca84-0d00-43ee-a034-f0f28a7e908e req-0b3e781d-3db3-4934-a552-43ef13f8c3f6 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:37.513061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-abecca84-0d00-43ee-a034-f0f28a7e908e req-0b3e781d-3db3-4934-a552-43ef13f8c3f6 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:37.514022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-abecca84-0d00-43ee-a034-f0f28a7e908e req-0b3e781d-3db3-4934-a552-43ef13f8c3f6 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:37.531758 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-abecca84-0d00-43ee-a034-f0f28a7e908e req-0b3e781d-3db3-4934-a552-43ef13f8c3f6 service nova] Creating event network-vif-deleted:8f730b34-940d-4091-b2c0-79234034252e for instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 on hv-cinder-85505 Sep 01 14:59:37.553202 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-abecca84-0d00-43ee-a034-f0f28a7e908e req-0b3e781d-3db3-4934-a552-43ef13f8c3f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064329 Sep 01 14:59:37.553988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 77/140] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 14:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:37.936345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:37.937448 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:37.945750 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:37.947158 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:37.947875 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:37.949116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:37.950073 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:37.950533 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:37.991203 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:37.992931 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:37.993535 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:37.994194 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.objects.instance [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lazy-loading 'fault' on Instance uuid 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 {{(pid=120554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:59:38.064226 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb7098b844d743f5bafeb7ba15b3fdd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd925def3f55b435bb5452a0b5e5daff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:38.074146 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0d60cd04-b20d-4867-a13b-e0f30584dbaa tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 200 len: 1351 microversion: 2.1 time: 0.142517 Sep 01 14:59:38.088181 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 64/141] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:37 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 1351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:38.256380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-0a63d70f-faa3-496e-979b-b32e0fc76fdc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:38.257364 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-0a63d70f-faa3-496e-979b-b32e0fc76fdc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:38.264318 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0a63d70f-faa3-496e-979b-b32e0fc76fdc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:38.265288 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0a63d70f-faa3-496e-979b-b32e0fc76fdc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:38.265720 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0a63d70f-faa3-496e-979b-b32e0fc76fdc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:38.266691 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0a63d70f-faa3-496e-979b-b32e0fc76fdc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:38.267158 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0a63d70f-faa3-496e-979b-b32e0fc76fdc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:38.268075 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0a63d70f-faa3-496e-979b-b32e0fc76fdc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:38.456520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-0a63d70f-faa3-496e-979b-b32e0fc76fdc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:38.464446 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-0a63d70f-faa3-496e-979b-b32e0fc76fdc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.213015 Sep 01 14:59:38.465206 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 78/142] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:38 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:39.096130 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:39.097992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:39.101434 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:39.109123 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:39.109879 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:39.111899 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:39.113025 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:39.114231 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:39.114877 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:39.136457 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] HTTP exception thrown: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Request method failure captured: Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 HTTP/1.1 Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMigULHVP4CgquNxQQnndGQZIbtPZyZOW7Xio8U1zhl8xD0qRZ0QNTE_aj9JtntvG6zUWpRghbCfW9HWFikpkkJSkXCd8aY7LENw7_RtTgc1QB6qNhoZukya6CaX52yeQauO4ZVcRLNIK7eAUQqMor8rOYYntIe4ntDGZIfs0NhDuyc Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: d925def3f55b435bb5452a0b5e5daff5 Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 14:59:39.141384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d925def3f55b435bb5452a0b5e5daff5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: d925def3f55b435bb5452a0b5e5daff5 Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-DeleteServersTestJSON-1044903701-project Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: bb7098b844d743f5bafeb7ba15b3fdd7 Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-DeleteServersTestJSON-1044903701-project Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:39.143527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '9dda2c56-8fb3-4c9f-8942-9c1cf30ec182'} Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:59:39.144542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:39.146022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:39.148344 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Returning 404 to user: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:59:39.148344 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6de561df-3a1f-4b85-a081-8f28a8a8fe6a tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 404 len: 111 microversion: 2.1 time: 0.054117 Sep 01 14:59:39.148344 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 65/143] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:39 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:59:39.311073 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:39.313605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:39.319685 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:39.320222 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:39.320590 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:39.321378 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:39.321861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:39.322467 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:39.327104 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:59:39.337902 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] HTTP exception thrown: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Request method failure captured: Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182/os-volume_attachments HTTP/1.1 Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMigULHVP4CgquNxQQnndGQZIbtPZyZOW7Xio8U1zhl8xD0qRZ0QNTE_aj9JtntvG6zUWpRghbCfW9HWFikpkkJSkXCd8aY7LENw7_RtTgc1QB6qNhoZukya6CaX52yeQauO4ZVcRLNIK7eAUQqMor8rOYYntIe4ntDGZIfs0NhDuyc Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: d925def3f55b435bb5452a0b5e5daff5 Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 14:59:39.342423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d925def3f55b435bb5452a0b5e5daff5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: d925def3f55b435bb5452a0b5e5daff5 Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-DeleteServersTestJSON-1044903701-project Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: bb7098b844d743f5bafeb7ba15b3fdd7 Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-DeleteServersTestJSON-1044903701-project Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:39.343872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'server_id': '9dda2c56-8fb3-4c9f-8942-9c1cf30ec182'} Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:59:39.344649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:39.345921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:39.348699 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Returning 404 to user: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:59:39.349752 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c81ef1a6-b1e0-405c-8380-e4ff44968fea tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044791 Sep 01 14:59:39.350532 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 79/144] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 14:59:39 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:59:39.500392 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-39726094-a1ed-47bc-8c01-967affcec171 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:39.501145 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-39726094-a1ed-47bc-8c01-967affcec171 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:39.512116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39726094-a1ed-47bc-8c01-967affcec171 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:39.514360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39726094-a1ed-47bc-8c01-967affcec171 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:39.514914 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39726094-a1ed-47bc-8c01-967affcec171 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:39.515733 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39726094-a1ed-47bc-8c01-967affcec171 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:39.517257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39726094-a1ed-47bc-8c01-967affcec171 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:39.517803 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39726094-a1ed-47bc-8c01-967affcec171 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:39.708977 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-39726094-a1ed-47bc-8c01-967affcec171 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:39.716738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-39726094-a1ed-47bc-8c01-967affcec171 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.223406 Sep 01 14:59:39.717296 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 66/145] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:39 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:40.646938 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:40.647429 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:40.669028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:40.669028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:40.669028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:40.669028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:40.669819 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:40.669819 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:40.683946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] HTTP exception thrown: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Request method failure captured: Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: DELETE /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 HTTP/1.1 Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMigULHVP4CgquNxQQnndGQZIbtPZyZOW7Xio8U1zhl8xD0qRZ0QNTE_aj9JtntvG6zUWpRghbCfW9HWFikpkkJSkXCd8aY7LENw7_RtTgc1QB6qNhoZukya6CaX52yeQauO4ZVcRLNIK7eAUQqMor8rOYYntIe4ntDGZIfs0NhDuyc Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: d925def3f55b435bb5452a0b5e5daff5 Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 14:59:40.686070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d925def3f55b435bb5452a0b5e5daff5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: d925def3f55b435bb5452a0b5e5daff5 Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-DeleteServersTestJSON-1044903701-project Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: bb7098b844d743f5bafeb7ba15b3fdd7 Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-DeleteServersTestJSON-1044903701-project Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:40.687347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '9dda2c56-8fb3-4c9f-8942-9c1cf30ec182'} Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:59:40.688213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:40.689269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:40.690966 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Returning 404 to user: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:59:40.690966 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-70f01056-54bc-4757-8b85-ef14e12d638c tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 404 len: 111 microversion: 2.1 time: 0.045014 Sep 01 14:59:40.690966 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 80/146] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 14:59:40 2022] DELETE /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:59:40.696966 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:40.697574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] [instance: 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:40.704102 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:40.704606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:40.705041 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:40.706031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:40.706516 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:40.706932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:40.720463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] HTTP exception thrown: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Request method failure captured: Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 HTTP/1.1 Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMigULHVP4CgquNxQQnndGQZIbtPZyZOW7Xio8U1zhl8xD0qRZ0QNTE_aj9JtntvG6zUWpRghbCfW9HWFikpkkJSkXCd8aY7LENw7_RtTgc1QB6qNhoZukya6CaX52yeQauO4ZVcRLNIK7eAUQqMor8rOYYntIe4ntDGZIfs0NhDuyc Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: d925def3f55b435bb5452a0b5e5daff5 Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 14:59:40.721957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d925def3f55b435bb5452a0b5e5daff5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d925def3f55b435bb5452a0b5e5daff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: d925def3f55b435bb5452a0b5e5daff5 Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-DeleteServersTestJSON-1044903701 Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-DeleteServersTestJSON-1044903701-project Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: bb7098b844d743f5bafeb7ba15b3fdd7 Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-DeleteServersTestJSON-1044903701-project Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:40.723178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '9dda2c56-8fb3-4c9f-8942-9c1cf30ec182'} Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:59:40.723823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. Sep 01 14:59:40.725356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:40.726362 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] Returning 404 to user: Instance 9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:59:40.726362 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7dcec8ac-c7de-4e6a-a7f4-d91cadb9fb89 tempest-DeleteServersTestJSON-1044903701 tempest-DeleteServersTestJSON-1044903701-project] 10.222.0.33 "GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182" status: 404 len: 111 microversion: 2.1 time: 0.030164 Sep 01 14:59:40.726362 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 67/147] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:40 2022] GET /compute/v2.1/servers/9dda2c56-8fb3-4c9f-8942-9c1cf30ec182 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:59:40.738541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-18e7438a-7d36-47b2-ae37-c0f832252951 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:40.739163 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-18e7438a-7d36-47b2-ae37-c0f832252951 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:40.745881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18e7438a-7d36-47b2-ae37-c0f832252951 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:40.746468 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18e7438a-7d36-47b2-ae37-c0f832252951 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:40.746910 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18e7438a-7d36-47b2-ae37-c0f832252951 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:40.747613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18e7438a-7d36-47b2-ae37-c0f832252951 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:40.748072 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18e7438a-7d36-47b2-ae37-c0f832252951 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:40.748498 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18e7438a-7d36-47b2-ae37-c0f832252951 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:40.893475 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-18e7438a-7d36-47b2-ae37-c0f832252951 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:40.902185 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-18e7438a-7d36-47b2-ae37-c0f832252951 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.168201 Sep 01 14:59:40.902833 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 81/148] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:40 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:41.923748 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5ddcfc56-3c7b-49ee-87a6-89c7a86f3186 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:41.925478 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5ddcfc56-3c7b-49ee-87a6-89c7a86f3186 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:41.933645 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ddcfc56-3c7b-49ee-87a6-89c7a86f3186 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:41.934220 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ddcfc56-3c7b-49ee-87a6-89c7a86f3186 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:41.934810 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ddcfc56-3c7b-49ee-87a6-89c7a86f3186 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:41.935730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ddcfc56-3c7b-49ee-87a6-89c7a86f3186 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:41.936284 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ddcfc56-3c7b-49ee-87a6-89c7a86f3186 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:41.936817 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ddcfc56-3c7b-49ee-87a6-89c7a86f3186 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:42.210611 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-5ddcfc56-3c7b-49ee-87a6-89c7a86f3186 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:42.218435 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5ddcfc56-3c7b-49ee-87a6-89c7a86f3186 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.298969 Sep 01 14:59:42.219225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 68/149] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:41 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:43.240722 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d0f54e2d-7877-4364-87fb-b3721f6b1629 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:43.241445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d0f54e2d-7877-4364-87fb-b3721f6b1629 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:43.247343 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d0f54e2d-7877-4364-87fb-b3721f6b1629 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:43.247868 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d0f54e2d-7877-4364-87fb-b3721f6b1629 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:43.248306 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d0f54e2d-7877-4364-87fb-b3721f6b1629 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:43.248990 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d0f54e2d-7877-4364-87fb-b3721f6b1629 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:43.249444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d0f54e2d-7877-4364-87fb-b3721f6b1629 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:43.249865 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d0f54e2d-7877-4364-87fb-b3721f6b1629 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:43.381640 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d0f54e2d-7877-4364-87fb-b3721f6b1629 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:43.389252 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d0f54e2d-7877-4364-87fb-b3721f6b1629 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.153075 Sep 01 14:59:43.389811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 82/150] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:43 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:44.411717 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-55388203-abd4-4291-9824-5cf63f392d4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:44.412341 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-55388203-abd4-4291-9824-5cf63f392d4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:44.419124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-55388203-abd4-4291-9824-5cf63f392d4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:44.419614 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-55388203-abd4-4291-9824-5cf63f392d4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:44.420053 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-55388203-abd4-4291-9824-5cf63f392d4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:44.420747 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-55388203-abd4-4291-9824-5cf63f392d4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:44.421199 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-55388203-abd4-4291-9824-5cf63f392d4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:44.421625 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-55388203-abd4-4291-9824-5cf63f392d4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:44.568366 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-55388203-abd4-4291-9824-5cf63f392d4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:44.576112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-55388203-abd4-4291-9824-5cf63f392d4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.169287 Sep 01 14:59:44.576671 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 69/151] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:44 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:45.503423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1b2e3494-93f1-4d85-8391-2aab89b2fea4 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Action: 'create', calling method: .version_select at 0x7fab73f46700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-268717664"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:45.597537 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-89e729cb-fcbd-461d-8a2b-25dce4f3d483 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:45.598164 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-89e729cb-fcbd-461d-8a2b-25dce4f3d483 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:45.605498 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e729cb-fcbd-461d-8a2b-25dce4f3d483 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:45.607305 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e729cb-fcbd-461d-8a2b-25dce4f3d483 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:45.607743 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e729cb-fcbd-461d-8a2b-25dce4f3d483 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:45.608463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e729cb-fcbd-461d-8a2b-25dce4f3d483 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:45.608931 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e729cb-fcbd-461d-8a2b-25dce4f3d483 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:45.609363 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e729cb-fcbd-461d-8a2b-25dce4f3d483 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:45.795797 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-89e729cb-fcbd-461d-8a2b-25dce4f3d483 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:45.821425 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-89e729cb-fcbd-461d-8a2b-25dce4f3d483 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.228019 Sep 01 14:59:45.822350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 70/152] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:45 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:45.864211 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1b2e3494-93f1-4d85-8391-2aab89b2fea4 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.484739 Sep 01 14:59:45.864822 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 83/153] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Sep 1 14:59:45 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 486 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 14:59:45.881931 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-850cb85d-786b-46e9-9d05-3ed4361a83a1 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73fbfe50>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:45.938728 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-850cb85d-786b-46e9-9d05-3ed4361a83a1 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a" status: 200 len: 344 microversion: 2.1 time: 0.064538 Sep 01 14:59:45.939290 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 71/154] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 14:59:45 2022] GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:59:46.844769 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-98167a87-7262-4b21-82ee-03dd827b72b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:46.845391 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-98167a87-7262-4b21-82ee-03dd827b72b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:46.852138 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98167a87-7262-4b21-82ee-03dd827b72b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:46.852526 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98167a87-7262-4b21-82ee-03dd827b72b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:46.852956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98167a87-7262-4b21-82ee-03dd827b72b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:46.853638 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98167a87-7262-4b21-82ee-03dd827b72b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:46.854285 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98167a87-7262-4b21-82ee-03dd827b72b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:46.854624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98167a87-7262-4b21-82ee-03dd827b72b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:46.952973 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9eeb40a6-5156-4437-9be0-ce634d0b9424 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73fb63a0>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:46.992859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-98167a87-7262-4b21-82ee-03dd827b72b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:47.000668 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-98167a87-7262-4b21-82ee-03dd827b72b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.159784 Sep 01 14:59:47.001322 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 84/155] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:46 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:47.009068 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9eeb40a6-5156-4437-9be0-ce634d0b9424 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a" status: 200 len: 345 microversion: 2.1 time: 0.059734 Sep 01 14:59:47.009699 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 72/156] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 14:59:46 2022] GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:59:47.023456 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-be9d422c-053a-44b7-94fb-4b80e0aede69 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Action: 'create', calling method: .version_select at 0x7fab73f463a0>, body: {"snapshot": {"volume_id": "d9a2c885-237e-4231-b82d-feb14b218a3a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-265149266"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:59:47.178975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-be9d422c-053a-44b7-94fb-4b80e0aede69 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.159551 Sep 01 14:59:47.179710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 85/157] 10.222.0.33 () {60 vars in 1162 bytes} [Thu Sep 1 14:59:47 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:47.191116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-fee56650-645c-486e-95a6-884d0463c12d tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73f52f70>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:47.224345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-fee56650-645c-486e-95a6-884d0463c12d tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17" status: 200 len: 286 microversion: 2.1 time: 0.037810 Sep 01 14:59:47.224910 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 73/158] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 1 14:59:47 2022] GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:47.235821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8154fbfc-197d-4198-82ba-f75d7ef2cff2 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73f84c10>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:47.266080 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8154fbfc-197d-4198-82ba-f75d7ef2cff2 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034313 Sep 01 14:59:47.266659 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 86/159] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Sep 1 14:59:47 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:47.277776 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-fb2fce2b-eca8-4ebf-9a14-f8fd31c62cd4 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73f52160>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:47.308339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-fb2fce2b-eca8-4ebf-9a14-f8fd31c62cd4 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17" status: 200 len: 286 microversion: 2.1 time: 0.034176 Sep 01 14:59:47.308900 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 74/160] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 1 14:59:47 2022] GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:48.023980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4362667c-5f5f-4838-9e3e-ec97530e7743 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:48.024606 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4362667c-5f5f-4838-9e3e-ec97530e7743 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:48.040155 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4362667c-5f5f-4838-9e3e-ec97530e7743 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:48.040685 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4362667c-5f5f-4838-9e3e-ec97530e7743 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:48.041331 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4362667c-5f5f-4838-9e3e-ec97530e7743 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:48.042202 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4362667c-5f5f-4838-9e3e-ec97530e7743 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:48.042857 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4362667c-5f5f-4838-9e3e-ec97530e7743 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:48.043293 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4362667c-5f5f-4838-9e3e-ec97530e7743 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:48.187835 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4362667c-5f5f-4838-9e3e-ec97530e7743 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:48.197409 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4362667c-5f5f-4838-9e3e-ec97530e7743 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.177406 Sep 01 14:59:48.197974 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 87/161] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:48 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:48.322054 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ed3071bb-20b5-41b2-8823-7a42f3c0504e tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73fbfaf0>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:48.352077 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ed3071bb-20b5-41b2-8823-7a42f3c0504e tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17" status: 200 len: 286 microversion: 2.1 time: 0.034255 Sep 01 14:59:48.352640 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 75/162] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 1 14:59:48 2022] GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:49.219644 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a71d40ae-a687-4e49-8fd6-d498c8b6aa8c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:49.220299 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a71d40ae-a687-4e49-8fd6-d498c8b6aa8c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:49.226538 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a71d40ae-a687-4e49-8fd6-d498c8b6aa8c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:49.227022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a71d40ae-a687-4e49-8fd6-d498c8b6aa8c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:49.227458 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a71d40ae-a687-4e49-8fd6-d498c8b6aa8c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:49.228157 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a71d40ae-a687-4e49-8fd6-d498c8b6aa8c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:49.228609 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a71d40ae-a687-4e49-8fd6-d498c8b6aa8c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:49.229034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a71d40ae-a687-4e49-8fd6-d498c8b6aa8c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:49.361910 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a71d40ae-a687-4e49-8fd6-d498c8b6aa8c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:49.364667 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-90c872c0-8552-4772-b8a7-6d80ba8373ed tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab780c2550>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:49.371189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a71d40ae-a687-4e49-8fd6-d498c8b6aa8c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.156414 Sep 01 14:59:49.371802 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 88/163] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:49 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:49.409990 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-90c872c0-8552-4772-b8a7-6d80ba8373ed tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17" status: 200 len: 286 microversion: 2.1 time: 0.049670 Sep 01 14:59:49.410790 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 76/164] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 1 14:59:49 2022] GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17 => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:59:50.392461 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1b11193c-6cf0-4cf3-bca9-7c786cc702fb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:50.393015 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1b11193c-6cf0-4cf3-bca9-7c786cc702fb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:50.398944 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b11193c-6cf0-4cf3-bca9-7c786cc702fb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:50.399428 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b11193c-6cf0-4cf3-bca9-7c786cc702fb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:50.399860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b11193c-6cf0-4cf3-bca9-7c786cc702fb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:50.400539 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b11193c-6cf0-4cf3-bca9-7c786cc702fb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:50.400992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b11193c-6cf0-4cf3-bca9-7c786cc702fb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:50.401416 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b11193c-6cf0-4cf3-bca9-7c786cc702fb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:50.423112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d1f1dfba-421c-4949-adc7-bb892c20a1f8 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73fbff70>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:50.453305 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d1f1dfba-421c-4949-adc7-bb892c20a1f8 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17" status: 200 len: 286 microversion: 2.1 time: 0.034357 Sep 01 14:59:50.453900 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 77/165] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 1 14:59:50 2022] GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:59:50.528395 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1b11193c-6cf0-4cf3-bca9-7c786cc702fb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:50.536019 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1b11193c-6cf0-4cf3-bca9-7c786cc702fb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.147462 Sep 01 14:59:50.536583 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 89/166] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:50 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:51.465486 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3b7284c7-4839-4774-b968-5b508d8f3e16 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73f525e0>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:51.500267 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3b7284c7-4839-4774-b968-5b508d8f3e16 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17" status: 200 len: 287 microversion: 2.1 time: 0.039034 Sep 01 14:59:51.500947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 78/167] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 1 14:59:51 2022] GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:59:51.518160 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a2fc93c6-b3a6-464c-a4a2-a4d1cf24e4a5 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73fa4550>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:51.557625 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-72b234ec-ed1d-4374-bcbf-7b1776f4c51e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:51.558671 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-72b234ec-ed1d-4374-bcbf-7b1776f4c51e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:51.565783 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72b234ec-ed1d-4374-bcbf-7b1776f4c51e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:51.566291 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72b234ec-ed1d-4374-bcbf-7b1776f4c51e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:51.566737 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72b234ec-ed1d-4374-bcbf-7b1776f4c51e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:51.567567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72b234ec-ed1d-4374-bcbf-7b1776f4c51e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:51.567932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72b234ec-ed1d-4374-bcbf-7b1776f4c51e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:51.568404 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72b234ec-ed1d-4374-bcbf-7b1776f4c51e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:51.581186 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a2fc93c6-b3a6-464c-a4a2-a4d1cf24e4a5 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17" status: 202 len: 0 microversion: 2.1 time: 0.070415 Sep 01 14:59:51.585080 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 90/168] 10.222.0.33 () {58 vars in 1254 bytes} [Thu Sep 1 14:59:51 2022] DELETE /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:59:51.590980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-49c4f551-bbf7-475c-a0ff-d13f7271b60c tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73f97af0>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:51.628756 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-49c4f551-bbf7-475c-a0ff-d13f7271b60c tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17" status: 200 len: 286 microversion: 2.1 time: 0.042400 Sep 01 14:59:51.629499 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 91/169] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 1 14:59:51 2022] GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:59:51.710954 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-72b234ec-ed1d-4374-bcbf-7b1776f4c51e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:51.719639 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-72b234ec-ed1d-4374-bcbf-7b1776f4c51e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.166404 Sep 01 14:59:51.720213 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 79/170] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:51 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:59:52.640626 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-012cf79a-5468-4edc-8398-40428d52dd9e tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab781eb820>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:52.683991 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-012cf79a-5468-4edc-8398-40428d52dd9e tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] HTTP exception thrown: Snapshot ac787e3d-edc9-47f7-b2c3-cbd91e040a17 could not be found. Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-012cf79a-5468-4edc-8398-40428d52dd9e tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Request method failure captured: Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17 HTTP/1.1 Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMjh6BzmpCldE9cUnSKxn3qM5hJOMsysQStGL4_3VjzpAC-Koko3DjKNxGqtP75fUaP9TRuItXu1nqcEa_hi9SJpN14Vu4dnox8CrHqm1lvgsHbpgWUCO70yrGAonKXV4GHdfqpPlyI30s9SiWMQTpnbvWVWK08e8eO89un-h4ussaM Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 96a9dae3808140258407c30997c62b73 Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 14:59:52.686187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/96a9dae3808140258407c30997c62b73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96a9dae3808140258407c30997c62b73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_96a9dae3808140258407c30997c62b73", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96a9dae3808140258407c30997c62b73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 96a9dae3808140258407c30997c62b73 Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-VolumesSnapshotsTestJSON-842112380-project Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: aae2f6b4ac014595a04b1e136ccf13b0 Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842112380-project Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Snapshot ac787e3d-edc9-47f7-b2c3-cbd91e040a17 could not be found. Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': 'ac787e3d-edc9-47f7-b2c3-cbd91e040a17'} Sep 01 14:59:52.687434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ac787e3d-edc9-47f7-b2c3-cbd91e040a17 could not be found. (HTTP 404) (Request-ID: req-5d15beb7-9a97-4905-b3c7-0389053631ff) Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:52.688266 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:59:52.689403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ac787e3d-edc9-47f7-b2c3-cbd91e040a17 could not be found. Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 14:59:52.690511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ac787e3d-edc9-47f7-b2c3-cbd91e040a17 could not be found. Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ac787e3d-edc9-47f7-b2c3-cbd91e040a17 could not be found. Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-012cf79a-5468-4edc-8398-40428d52dd9e tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Returning 404 to user: Snapshot ac787e3d-edc9-47f7-b2c3-cbd91e040a17 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-012cf79a-5468-4edc-8398-40428d52dd9e tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17" status: 404 len: 111 microversion: 2.1 time: 0.050800 Sep 01 14:59:52.691620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 92/171] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 1 14:59:52 2022] GET /compute/v2.1/os-snapshots/ac787e3d-edc9-47f7-b2c3-cbd91e040a17 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:59:52.696797 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-198e2edf-e2c4-4513-ac4e-c9654570f30a tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73fbfb80>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:52.745283 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9c252f32-e646-4dda-9aa7-5694e0bbb63f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:52.746062 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9c252f32-e646-4dda-9aa7-5694e0bbb63f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:52.752753 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c252f32-e646-4dda-9aa7-5694e0bbb63f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:52.753257 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c252f32-e646-4dda-9aa7-5694e0bbb63f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:52.754062 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c252f32-e646-4dda-9aa7-5694e0bbb63f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:52.754982 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c252f32-e646-4dda-9aa7-5694e0bbb63f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:52.755639 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c252f32-e646-4dda-9aa7-5694e0bbb63f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:52.756260 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c252f32-e646-4dda-9aa7-5694e0bbb63f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:52.784293 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-198e2edf-e2c4-4513-ac4e-c9654570f30a tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a" status: 202 len: 0 microversion: 2.1 time: 0.091284 Sep 01 14:59:52.785389 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 80/172] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 1 14:59:52 2022] DELETE /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:59:52.794213 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-adf93931-8e73-476b-b358-16136fb2c953 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73fb1310>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:52.855565 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-adf93931-8e73-476b-b358-16136fb2c953 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a" status: 200 len: 344 microversion: 2.1 time: 0.065555 Sep 01 14:59:52.862116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 81/173] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 14:59:52 2022] GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:59:52.906528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9c252f32-e646-4dda-9aa7-5694e0bbb63f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:52.914980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9c252f32-e646-4dda-9aa7-5694e0bbb63f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.175457 Sep 01 14:59:52.915576 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 93/174] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:52 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:53.869882 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0c3edf1b-e0d8-4280-ab6c-83c3b68352bb tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab78217d30>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:53.899033 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-0c3edf1b-e0d8-4280-ab6c-83c3b68352bb tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] HTTP exception thrown: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0c3edf1b-e0d8-4280-ab6c-83c3b68352bb tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Request method failure captured: Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a HTTP/1.1 Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMjh6BzmpCldE9cUnSKxn3qM5hJOMsysQStGL4_3VjzpAC-Koko3DjKNxGqtP75fUaP9TRuItXu1nqcEa_hi9SJpN14Vu4dnox8CrHqm1lvgsHbpgWUCO70yrGAonKXV4GHdfqpPlyI30s9SiWMQTpnbvWVWK08e8eO89un-h4ussaM Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 96a9dae3808140258407c30997c62b73 Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 14:59:53.900955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/96a9dae3808140258407c30997c62b73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96a9dae3808140258407c30997c62b73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_96a9dae3808140258407c30997c62b73", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96a9dae3808140258407c30997c62b73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 96a9dae3808140258407c30997c62b73 Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-VolumesSnapshotsTestJSON-842112380-project Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: aae2f6b4ac014595a04b1e136ccf13b0 Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842112380-project Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': 'd9a2c885-237e-4231-b82d-feb14b218a3a'} Sep 01 14:59:53.902387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. (HTTP 404) (Request-ID: req-47261b8e-0dc8-4c81-b16a-e6584bb71377) Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:53.903166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:59:53.904225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:59:53.905257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0c3edf1b-e0d8-4280-ab6c-83c3b68352bb tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Returning 404 to user: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0c3edf1b-e0d8-4280-ab6c-83c3b68352bb tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a" status: 404 len: 109 microversion: 2.1 time: 0.037333 Sep 01 14:59:53.907002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 82/175] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 14:59:53 2022] GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:59:53.916973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ee0c7a98-7777-48a7-85fb-6d6b0a88723a tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73f44280>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:53.941588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-bcac3dcb-8828-4de7-866b-1ce824b25025 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:53.942223 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-bcac3dcb-8828-4de7-866b-1ce824b25025 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:53.949224 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bcac3dcb-8828-4de7-866b-1ce824b25025 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:53.949715 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bcac3dcb-8828-4de7-866b-1ce824b25025 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:53.950391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bcac3dcb-8828-4de7-866b-1ce824b25025 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:53.950877 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bcac3dcb-8828-4de7-866b-1ce824b25025 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:53.951423 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bcac3dcb-8828-4de7-866b-1ce824b25025 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:53.951754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bcac3dcb-8828-4de7-866b-1ce824b25025 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:53.959741 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-ee0c7a98-7777-48a7-85fb-6d6b0a88723a tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] HTTP exception thrown: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ee0c7a98-7777-48a7-85fb-6d6b0a88723a tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Request method failure captured: Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: DELETE /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a HTTP/1.1 Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMjh6BzmpCldE9cUnSKxn3qM5hJOMsysQStGL4_3VjzpAC-Koko3DjKNxGqtP75fUaP9TRuItXu1nqcEa_hi9SJpN14Vu4dnox8CrHqm1lvgsHbpgWUCO70yrGAonKXV4GHdfqpPlyI30s9SiWMQTpnbvWVWK08e8eO89un-h4ussaM Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 96a9dae3808140258407c30997c62b73 Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 14:59:53.962400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/96a9dae3808140258407c30997c62b73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96a9dae3808140258407c30997c62b73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_96a9dae3808140258407c30997c62b73", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96a9dae3808140258407c30997c62b73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 96a9dae3808140258407c30997c62b73 Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-VolumesSnapshotsTestJSON-842112380-project Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: aae2f6b4ac014595a04b1e136ccf13b0 Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842112380-project Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': 'd9a2c885-237e-4231-b82d-feb14b218a3a'} Sep 01 14:59:53.964051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. (HTTP 404) (Request-ID: req-24a2ffcd-dcaf-4cc2-96ec-76a6fe625f3c) Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:53.964772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:59:53.965861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 14:59:53.967103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:59:53.968105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:53.968105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.968105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:53.968105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.968105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:53.968105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:53.968105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:53.968105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:59:53.968105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:59:53.968105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:53.968105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:53.969692 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ee0c7a98-7777-48a7-85fb-6d6b0a88723a tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Returning 404 to user: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:59:53.971397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ee0c7a98-7777-48a7-85fb-6d6b0a88723a tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a" status: 404 len: 109 microversion: 2.1 time: 0.057594 Sep 01 14:59:53.972091 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 94/176] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 1 14:59:53 2022] DELETE /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:59:53.979740 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-85cddd66-5c3d-4f2f-abb5-a8096460feb2 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Calling method '.version_select at 0x7fab73f46790>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:54.010330 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-85cddd66-5c3d-4f2f-abb5-a8096460feb2 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] HTTP exception thrown: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-85cddd66-5c3d-4f2f-abb5-a8096460feb2 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Request method failure captured: Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a HTTP/1.1 Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMjh6BzmpCldE9cUnSKxn3qM5hJOMsysQStGL4_3VjzpAC-Koko3DjKNxGqtP75fUaP9TRuItXu1nqcEa_hi9SJpN14Vu4dnox8CrHqm1lvgsHbpgWUCO70yrGAonKXV4GHdfqpPlyI30s9SiWMQTpnbvWVWK08e8eO89un-h4ussaM Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 96a9dae3808140258407c30997c62b73 Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 14:59:54.016397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/96a9dae3808140258407c30997c62b73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96a9dae3808140258407c30997c62b73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_96a9dae3808140258407c30997c62b73", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/96a9dae3808140258407c30997c62b73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 96a9dae3808140258407c30997c62b73 Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842112380 Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-VolumesSnapshotsTestJSON-842112380-project Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: aae2f6b4ac014595a04b1e136ccf13b0 Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842112380-project Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': 'd9a2c885-237e-4231-b82d-feb14b218a3a'} Sep 01 14:59:54.017723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. (HTTP 404) (Request-ID: req-13068091-b317-4e4c-b940-e638ac8c87c5) Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:54.018464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:59:54.019489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:59:54.020508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-85cddd66-5c3d-4f2f-abb5-a8096460feb2 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] Returning 404 to user: Volume d9a2c885-237e-4231-b82d-feb14b218a3a could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-85cddd66-5c3d-4f2f-abb5-a8096460feb2 tempest-VolumesSnapshotsTestJSON-842112380 tempest-VolumesSnapshotsTestJSON-842112380-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a" status: 404 len: 109 microversion: 2.1 time: 0.041310 Sep 01 14:59:54.021520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 95/177] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 14:59:53 2022] GET /compute/v2.1/os-volumes/d9a2c885-237e-4231-b82d-feb14b218a3a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:59:54.104806 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-bcac3dcb-8828-4de7-866b-1ce824b25025 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:54.118249 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-bcac3dcb-8828-4de7-866b-1ce824b25025 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.178450 Sep 01 14:59:54.118842 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 83/178] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:53 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:55.140070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-aee7beba-e54d-4f06-bb27-d084a2b0574b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:55.140825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-aee7beba-e54d-4f06-bb27-d084a2b0574b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:55.150721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aee7beba-e54d-4f06-bb27-d084a2b0574b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:55.151300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aee7beba-e54d-4f06-bb27-d084a2b0574b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:55.151815 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aee7beba-e54d-4f06-bb27-d084a2b0574b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:55.152757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aee7beba-e54d-4f06-bb27-d084a2b0574b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:55.153526 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aee7beba-e54d-4f06-bb27-d084a2b0574b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:55.154033 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aee7beba-e54d-4f06-bb27-d084a2b0574b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:55.308633 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-aee7beba-e54d-4f06-bb27-d084a2b0574b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:55.316431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-aee7beba-e54d-4f06-bb27-d084a2b0574b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.181134 Sep 01 14:59:55.317179 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 96/179] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:55 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:56.337725 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c269af00-cb4d-42d3-b039-7edb9eb09d7c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:56.338545 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c269af00-cb4d-42d3-b039-7edb9eb09d7c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:56.345345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c269af00-cb4d-42d3-b039-7edb9eb09d7c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:56.346698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c269af00-cb4d-42d3-b039-7edb9eb09d7c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:56.347442 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c269af00-cb4d-42d3-b039-7edb9eb09d7c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:56.348279 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c269af00-cb4d-42d3-b039-7edb9eb09d7c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:56.348908 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c269af00-cb4d-42d3-b039-7edb9eb09d7c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:56.349413 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c269af00-cb4d-42d3-b039-7edb9eb09d7c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:56.516143 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c269af00-cb4d-42d3-b039-7edb9eb09d7c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:56.526992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c269af00-cb4d-42d3-b039-7edb9eb09d7c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.192794 Sep 01 14:59:56.527945 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 84/180] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:56 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:57.547888 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-30a01498-e557-43a8-bce1-3f826af38607 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:57.548535 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-30a01498-e557-43a8-bce1-3f826af38607 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:57.557168 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30a01498-e557-43a8-bce1-3f826af38607 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:57.557665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30a01498-e557-43a8-bce1-3f826af38607 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:57.558096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30a01498-e557-43a8-bce1-3f826af38607 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:57.558999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30a01498-e557-43a8-bce1-3f826af38607 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:57.559542 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30a01498-e557-43a8-bce1-3f826af38607 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:57.560155 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30a01498-e557-43a8-bce1-3f826af38607 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:57.748934 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-30a01498-e557-43a8-bce1-3f826af38607 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:57.758331 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-30a01498-e557-43a8-bce1-3f826af38607 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.214159 Sep 01 14:59:57.758995 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 97/181] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:57 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:59:58.780109 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d51a7023-6336-4f56-b724-6384a57372c9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:59:58.781416 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d51a7023-6336-4f56-b724-6384a57372c9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:59:58.788008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51a7023-6336-4f56-b724-6384a57372c9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:58.789017 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51a7023-6336-4f56-b724-6384a57372c9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:58.789482 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51a7023-6336-4f56-b724-6384a57372c9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:58.790201 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51a7023-6336-4f56-b724-6384a57372c9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:59:58.790679 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51a7023-6336-4f56-b724-6384a57372c9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:59:58.791406 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51a7023-6336-4f56-b724-6384a57372c9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:59:58.994920 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d51a7023-6336-4f56-b724-6384a57372c9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:59:59.002774 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d51a7023-6336-4f56-b724-6384a57372c9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.226881 Sep 01 14:59:59.003542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 85/182] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 14:59:58 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:00.024824 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e14b81d1-ffed-4cd4-bad1-384e5f38340c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:00.025602 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e14b81d1-ffed-4cd4-bad1-384e5f38340c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:00.032767 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e14b81d1-ffed-4cd4-bad1-384e5f38340c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:00.033275 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e14b81d1-ffed-4cd4-bad1-384e5f38340c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:00.033713 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e14b81d1-ffed-4cd4-bad1-384e5f38340c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:00.034525 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e14b81d1-ffed-4cd4-bad1-384e5f38340c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:00.034984 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e14b81d1-ffed-4cd4-bad1-384e5f38340c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:00.035413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e14b81d1-ffed-4cd4-bad1-384e5f38340c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:00.174649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e14b81d1-ffed-4cd4-bad1-384e5f38340c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:00.182617 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e14b81d1-ffed-4cd4-bad1-384e5f38340c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.161979 Sep 01 15:00:00.183168 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 98/183] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:00 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:01.204484 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a3523c70-9a7f-42e6-b53a-22ddf6be5ca3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:01.205956 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a3523c70-9a7f-42e6-b53a-22ddf6be5ca3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:01.213054 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a3523c70-9a7f-42e6-b53a-22ddf6be5ca3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:01.213523 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a3523c70-9a7f-42e6-b53a-22ddf6be5ca3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:01.213955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a3523c70-9a7f-42e6-b53a-22ddf6be5ca3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:01.214675 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a3523c70-9a7f-42e6-b53a-22ddf6be5ca3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:01.215125 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a3523c70-9a7f-42e6-b53a-22ddf6be5ca3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:01.215549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a3523c70-9a7f-42e6-b53a-22ddf6be5ca3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:01.357332 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a3523c70-9a7f-42e6-b53a-22ddf6be5ca3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:01.365131 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a3523c70-9a7f-42e6-b53a-22ddf6be5ca3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.165090 Sep 01 15:00:01.365796 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 86/184] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:01 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:02.390692 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e99aa3bd-2a3f-4326-a777-5bae043caafe tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:02.391239 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e99aa3bd-2a3f-4326-a777-5bae043caafe tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:02.397676 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e99aa3bd-2a3f-4326-a777-5bae043caafe tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:02.398150 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e99aa3bd-2a3f-4326-a777-5bae043caafe tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:02.398620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e99aa3bd-2a3f-4326-a777-5bae043caafe tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:02.399298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e99aa3bd-2a3f-4326-a777-5bae043caafe tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:02.399750 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e99aa3bd-2a3f-4326-a777-5bae043caafe tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:02.400171 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e99aa3bd-2a3f-4326-a777-5bae043caafe tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:02.538683 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e99aa3bd-2a3f-4326-a777-5bae043caafe tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:02.546344 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e99aa3bd-2a3f-4326-a777-5bae043caafe tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.159456 Sep 01 15:00:02.546924 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 99/185] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:02 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:03.567112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-222b3801-3fb6-4700-af7f-6109e6eedceb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:03.567729 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-222b3801-3fb6-4700-af7f-6109e6eedceb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:03.574164 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-222b3801-3fb6-4700-af7f-6109e6eedceb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:03.574685 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-222b3801-3fb6-4700-af7f-6109e6eedceb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:03.575127 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-222b3801-3fb6-4700-af7f-6109e6eedceb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:03.575832 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-222b3801-3fb6-4700-af7f-6109e6eedceb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:03.576289 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-222b3801-3fb6-4700-af7f-6109e6eedceb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:03.576716 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-222b3801-3fb6-4700-af7f-6109e6eedceb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:03.710035 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-222b3801-3fb6-4700-af7f-6109e6eedceb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:03.717763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-222b3801-3fb6-4700-af7f-6109e6eedceb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.154500 Sep 01 15:00:03.718339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 87/186] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:03 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:04.739679 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-80a27098-2f6f-4101-8c36-b8b4040c2465 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:04.740484 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-80a27098-2f6f-4101-8c36-b8b4040c2465 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:04.742450 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=38 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:04.747738 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-80a27098-2f6f-4101-8c36-b8b4040c2465 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:04.748227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-80a27098-2f6f-4101-8c36-b8b4040c2465 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:04.748664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-80a27098-2f6f-4101-8c36-b8b4040c2465 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:04.749361 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-80a27098-2f6f-4101-8c36-b8b4040c2465 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:04.749818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-80a27098-2f6f-4101-8c36-b8b4040c2465 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:04.750319 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-80a27098-2f6f-4101-8c36-b8b4040c2465 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:04.874015 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-80a27098-2f6f-4101-8c36-b8b4040c2465 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:04.881709 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-80a27098-2f6f-4101-8c36-b8b4040c2465 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.145846 Sep 01 15:00:04.882267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 100/187] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:04 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:05.902819 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9088e42a-2468-4e11-b45e-0c6e9f0dbb57 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:05.903444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9088e42a-2468-4e11-b45e-0c6e9f0dbb57 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:05.910322 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9088e42a-2468-4e11-b45e-0c6e9f0dbb57 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:05.910808 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9088e42a-2468-4e11-b45e-0c6e9f0dbb57 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:05.911245 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9088e42a-2468-4e11-b45e-0c6e9f0dbb57 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:05.911931 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9088e42a-2468-4e11-b45e-0c6e9f0dbb57 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:05.912390 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9088e42a-2468-4e11-b45e-0c6e9f0dbb57 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:05.912824 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9088e42a-2468-4e11-b45e-0c6e9f0dbb57 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:06.041814 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9088e42a-2468-4e11-b45e-0c6e9f0dbb57 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:06.050105 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9088e42a-2468-4e11-b45e-0c6e9f0dbb57 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.151179 Sep 01 15:00:06.050758 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 88/188] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:05 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:07.070736 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c6980885-c057-4541-87cf-3af71bb22966 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:07.071380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c6980885-c057-4541-87cf-3af71bb22966 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:07.077676 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6980885-c057-4541-87cf-3af71bb22966 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:07.078270 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6980885-c057-4541-87cf-3af71bb22966 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:07.078718 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6980885-c057-4541-87cf-3af71bb22966 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:07.079421 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6980885-c057-4541-87cf-3af71bb22966 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:07.079881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6980885-c057-4541-87cf-3af71bb22966 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:07.080311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6980885-c057-4541-87cf-3af71bb22966 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:07.211418 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c6980885-c057-4541-87cf-3af71bb22966 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:07.219056 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c6980885-c057-4541-87cf-3af71bb22966 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.152041 Sep 01 15:00:07.219605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 101/189] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:07 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:08.240968 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d94e8318-e447-4d70-949b-19e0cac08afd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:08.241578 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d94e8318-e447-4d70-949b-19e0cac08afd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:08.248295 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d94e8318-e447-4d70-949b-19e0cac08afd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:08.248789 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d94e8318-e447-4d70-949b-19e0cac08afd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:08.249232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d94e8318-e447-4d70-949b-19e0cac08afd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:08.249938 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d94e8318-e447-4d70-949b-19e0cac08afd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:08.250432 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d94e8318-e447-4d70-949b-19e0cac08afd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:08.250866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d94e8318-e447-4d70-949b-19e0cac08afd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:08.255486 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=83 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:08.381370 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d94e8318-e447-4d70-949b-19e0cac08afd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:08.389978 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d94e8318-e447-4d70-949b-19e0cac08afd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.153121 Sep 01 15:00:08.390603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 89/190] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:08 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:09.410331 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-97e14fa7-613f-4aea-994d-5a3a43489be6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:09.411014 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-97e14fa7-613f-4aea-994d-5a3a43489be6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:09.417008 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-97e14fa7-613f-4aea-994d-5a3a43489be6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:09.417495 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-97e14fa7-613f-4aea-994d-5a3a43489be6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:09.417936 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-97e14fa7-613f-4aea-994d-5a3a43489be6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:09.418654 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-97e14fa7-613f-4aea-994d-5a3a43489be6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:09.419116 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-97e14fa7-613f-4aea-994d-5a3a43489be6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:09.419541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-97e14fa7-613f-4aea-994d-5a3a43489be6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:09.563761 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-97e14fa7-613f-4aea-994d-5a3a43489be6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:09.572342 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-97e14fa7-613f-4aea-994d-5a3a43489be6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.166397 Sep 01 15:00:09.572916 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 102/191] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:09 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:10.593537 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-dee89c89-0655-400c-849f-6423a119f61c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:10.594160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-dee89c89-0655-400c-849f-6423a119f61c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:10.596551 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=28 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:10.602307 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dee89c89-0655-400c-849f-6423a119f61c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:10.602795 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dee89c89-0655-400c-849f-6423a119f61c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:10.603236 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dee89c89-0655-400c-849f-6423a119f61c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:10.603930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dee89c89-0655-400c-849f-6423a119f61c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:10.604393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dee89c89-0655-400c-849f-6423a119f61c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:10.604829 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dee89c89-0655-400c-849f-6423a119f61c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:10.731105 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-dee89c89-0655-400c-849f-6423a119f61c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:10.740193 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-dee89c89-0655-400c-849f-6423a119f61c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.149101 Sep 01 15:00:10.740193 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 90/192] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:10 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:11.758628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-92ea23c7-c20a-42f1-b3a4-89efc5e02730 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:11.759251 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-92ea23c7-c20a-42f1-b3a4-89efc5e02730 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:11.765237 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-92ea23c7-c20a-42f1-b3a4-89efc5e02730 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:11.765722 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-92ea23c7-c20a-42f1-b3a4-89efc5e02730 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:11.766159 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-92ea23c7-c20a-42f1-b3a4-89efc5e02730 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:11.766877 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-92ea23c7-c20a-42f1-b3a4-89efc5e02730 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:11.767333 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-92ea23c7-c20a-42f1-b3a4-89efc5e02730 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:11.767848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-92ea23c7-c20a-42f1-b3a4-89efc5e02730 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:11.771716 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=87 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:11.893140 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-92ea23c7-c20a-42f1-b3a4-89efc5e02730 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:11.900715 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-92ea23c7-c20a-42f1-b3a4-89efc5e02730 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.145929 Sep 01 15:00:11.901275 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 103/193] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:11 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:12.922749 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c7ef42f8-9f06-48ed-8445-4137489d7fe2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:12.923334 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c7ef42f8-9f06-48ed-8445-4137489d7fe2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:12.929918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7ef42f8-9f06-48ed-8445-4137489d7fe2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:12.930446 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7ef42f8-9f06-48ed-8445-4137489d7fe2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:12.930893 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7ef42f8-9f06-48ed-8445-4137489d7fe2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:12.931592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7ef42f8-9f06-48ed-8445-4137489d7fe2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:12.932053 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7ef42f8-9f06-48ed-8445-4137489d7fe2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:12.932482 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7ef42f8-9f06-48ed-8445-4137489d7fe2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:13.099954 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c7ef42f8-9f06-48ed-8445-4137489d7fe2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:13.108190 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c7ef42f8-9f06-48ed-8445-4137489d7fe2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1521 microversion: 2.1 time: 0.189279 Sep 01 15:00:13.108855 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 91/194] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:12 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:14.129567 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ab137e8a-1c2e-4dd1-8419-7224ec639d0e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:14.130334 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ab137e8a-1c2e-4dd1-8419-7224ec639d0e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:14.136576 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab137e8a-1c2e-4dd1-8419-7224ec639d0e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:14.137072 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab137e8a-1c2e-4dd1-8419-7224ec639d0e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:14.137548 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab137e8a-1c2e-4dd1-8419-7224ec639d0e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:14.138346 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab137e8a-1c2e-4dd1-8419-7224ec639d0e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:14.139012 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab137e8a-1c2e-4dd1-8419-7224ec639d0e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:14.139440 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab137e8a-1c2e-4dd1-8419-7224ec639d0e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:14.280678 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ab137e8a-1c2e-4dd1-8419-7224ec639d0e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:14.289154 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ab137e8a-1c2e-4dd1-8419-7224ec639d0e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1501 microversion: 2.1 time: 0.164201 Sep 01 15:00:14.289707 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 104/195] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:14 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:14.308798 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b5076807-7953-438a-90f5-58a63340056c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:14.309947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b5076807-7953-438a-90f5-58a63340056c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:14.316350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5076807-7953-438a-90f5-58a63340056c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:14.316828 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5076807-7953-438a-90f5-58a63340056c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:14.317263 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5076807-7953-438a-90f5-58a63340056c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:14.317942 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5076807-7953-438a-90f5-58a63340056c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:14.318428 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5076807-7953-438a-90f5-58a63340056c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:14.318875 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5076807-7953-438a-90f5-58a63340056c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:14.451637 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b5076807-7953-438a-90f5-58a63340056c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:14.463813 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b5076807-7953-438a-90f5-58a63340056c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1516 microversion: 2.1 time: 0.158760 Sep 01 15:00:14.464560 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 92/196] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:14 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:15.875365 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-fb7e50e4-72bb-40ed-96a0-2ed9b8a1f0f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:15.877862 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-fb7e50e4-72bb-40ed-96a0-2ed9b8a1f0f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:15.884303 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb7e50e4-72bb-40ed-96a0-2ed9b8a1f0f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:15.884923 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb7e50e4-72bb-40ed-96a0-2ed9b8a1f0f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:15.885445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb7e50e4-72bb-40ed-96a0-2ed9b8a1f0f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:15.886159 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb7e50e4-72bb-40ed-96a0-2ed9b8a1f0f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:15.886724 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb7e50e4-72bb-40ed-96a0-2ed9b8a1f0f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:15.887210 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb7e50e4-72bb-40ed-96a0-2ed9b8a1f0f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:15.913059 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-fb7e50e4-72bb-40ed-96a0-2ed9b8a1f0f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lazy-loading 'flavor' on Instance uuid 7322e2bb-f39f-46ee-9193-1edd605d833f {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:00:15.998206 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-fb7e50e4-72bb-40ed-96a0-2ed9b8a1f0f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "POST /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f/action" status: 200 len: 32 microversion: 2.1 time: 0.127748 Sep 01 15:00:15.998923 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 105/197] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:00:15 2022] POST /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f/action => generated 32 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 15:00:16.016069 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-48ee32b6-9d85-4077-90c7-bbe98e1a57eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:16.016739 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-48ee32b6-9d85-4077-90c7-bbe98e1a57eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:16.029098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-48ee32b6-9d85-4077-90c7-bbe98e1a57eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:16.029914 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-48ee32b6-9d85-4077-90c7-bbe98e1a57eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:16.031538 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-48ee32b6-9d85-4077-90c7-bbe98e1a57eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:16.032491 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-48ee32b6-9d85-4077-90c7-bbe98e1a57eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:16.032996 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-48ee32b6-9d85-4077-90c7-bbe98e1a57eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:16.033485 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-48ee32b6-9d85-4077-90c7-bbe98e1a57eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:16.213241 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-48ee32b6-9d85-4077-90c7-bbe98e1a57eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:16.223522 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-48ee32b6-9d85-4077-90c7-bbe98e1a57eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.218277 Sep 01 15:00:16.226369 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 93/198] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:16 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:17.245916 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d488ea15-05c8-4a87-a7db-83325e8c6f33 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:17.246649 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d488ea15-05c8-4a87-a7db-83325e8c6f33 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:17.254516 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d488ea15-05c8-4a87-a7db-83325e8c6f33 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:17.255256 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d488ea15-05c8-4a87-a7db-83325e8c6f33 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:17.255707 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d488ea15-05c8-4a87-a7db-83325e8c6f33 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:17.256640 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d488ea15-05c8-4a87-a7db-83325e8c6f33 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:17.257375 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d488ea15-05c8-4a87-a7db-83325e8c6f33 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:17.257966 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d488ea15-05c8-4a87-a7db-83325e8c6f33 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:17.439760 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d488ea15-05c8-4a87-a7db-83325e8c6f33 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:17.448392 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d488ea15-05c8-4a87-a7db-83325e8c6f33 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.207040 Sep 01 15:00:17.448954 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 106/199] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:17 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:18.470492 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4d8e941b-dc59-462f-84ee-3a81ba5199d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:18.471392 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4d8e941b-dc59-462f-84ee-3a81ba5199d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:18.481919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d8e941b-dc59-462f-84ee-3a81ba5199d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:18.483052 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d8e941b-dc59-462f-84ee-3a81ba5199d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:18.483894 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d8e941b-dc59-462f-84ee-3a81ba5199d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:18.485271 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d8e941b-dc59-462f-84ee-3a81ba5199d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:18.486389 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d8e941b-dc59-462f-84ee-3a81ba5199d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:18.486980 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d8e941b-dc59-462f-84ee-3a81ba5199d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:18.682040 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4d8e941b-dc59-462f-84ee-3a81ba5199d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:18.690316 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4d8e941b-dc59-462f-84ee-3a81ba5199d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.224396 Sep 01 15:00:18.691132 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 94/200] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:18 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:19.713628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7cd61e99-dd20-41b1-bf86-a96412e7e621 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:19.714281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7cd61e99-dd20-41b1-bf86-a96412e7e621 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:19.721381 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7cd61e99-dd20-41b1-bf86-a96412e7e621 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:19.721876 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7cd61e99-dd20-41b1-bf86-a96412e7e621 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:19.722345 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7cd61e99-dd20-41b1-bf86-a96412e7e621 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:19.723052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7cd61e99-dd20-41b1-bf86-a96412e7e621 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:19.723513 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7cd61e99-dd20-41b1-bf86-a96412e7e621 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:19.724515 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7cd61e99-dd20-41b1-bf86-a96412e7e621 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:19.871039 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-7cd61e99-dd20-41b1-bf86-a96412e7e621 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:19.880724 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7cd61e99-dd20-41b1-bf86-a96412e7e621 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.171788 Sep 01 15:00:19.881417 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 107/201] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:19 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:20.902161 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9a3a72ae-a203-4ee3-8eec-5e8feff5d0db tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:20.902739 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9a3a72ae-a203-4ee3-8eec-5e8feff5d0db tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:20.908945 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a3a72ae-a203-4ee3-8eec-5e8feff5d0db tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:20.909428 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a3a72ae-a203-4ee3-8eec-5e8feff5d0db tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:20.909861 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a3a72ae-a203-4ee3-8eec-5e8feff5d0db tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:20.910582 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a3a72ae-a203-4ee3-8eec-5e8feff5d0db tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:20.911036 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a3a72ae-a203-4ee3-8eec-5e8feff5d0db tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:20.911484 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a3a72ae-a203-4ee3-8eec-5e8feff5d0db tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:21.039126 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9a3a72ae-a203-4ee3-8eec-5e8feff5d0db tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:21.046730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9a3a72ae-a203-4ee3-8eec-5e8feff5d0db tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.148439 Sep 01 15:00:21.047284 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 95/202] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:20 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:22.069150 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-74110beb-10e0-4c57-a034-003792be7dd2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:22.069871 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-74110beb-10e0-4c57-a034-003792be7dd2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:22.076448 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74110beb-10e0-4c57-a034-003792be7dd2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:22.077135 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74110beb-10e0-4c57-a034-003792be7dd2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:22.077570 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74110beb-10e0-4c57-a034-003792be7dd2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:22.078535 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74110beb-10e0-4c57-a034-003792be7dd2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:22.078901 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74110beb-10e0-4c57-a034-003792be7dd2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:22.079466 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-74110beb-10e0-4c57-a034-003792be7dd2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:22.239098 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-74110beb-10e0-4c57-a034-003792be7dd2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:22.247489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-74110beb-10e0-4c57-a034-003792be7dd2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.182615 Sep 01 15:00:22.248057 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 108/203] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:22 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:23.268866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0507a5b3-9bde-4a7c-906f-bea66a766f98 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:23.269563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0507a5b3-9bde-4a7c-906f-bea66a766f98 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:23.277086 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0507a5b3-9bde-4a7c-906f-bea66a766f98 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:23.277680 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0507a5b3-9bde-4a7c-906f-bea66a766f98 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:23.278101 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0507a5b3-9bde-4a7c-906f-bea66a766f98 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:23.278822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0507a5b3-9bde-4a7c-906f-bea66a766f98 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:23.279281 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0507a5b3-9bde-4a7c-906f-bea66a766f98 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:23.279702 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0507a5b3-9bde-4a7c-906f-bea66a766f98 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:23.412951 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0507a5b3-9bde-4a7c-906f-bea66a766f98 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:23.420722 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0507a5b3-9bde-4a7c-906f-bea66a766f98 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.155719 Sep 01 15:00:23.421291 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 96/204] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:23 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:24.442094 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-386fd9e3-c64f-4837-9230-7f8a23940875 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:24.443238 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-386fd9e3-c64f-4837-9230-7f8a23940875 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:24.449181 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-386fd9e3-c64f-4837-9230-7f8a23940875 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:24.449667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-386fd9e3-c64f-4837-9230-7f8a23940875 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:24.450153 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-386fd9e3-c64f-4837-9230-7f8a23940875 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:24.450870 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-386fd9e3-c64f-4837-9230-7f8a23940875 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:24.451327 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-386fd9e3-c64f-4837-9230-7f8a23940875 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:24.451753 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-386fd9e3-c64f-4837-9230-7f8a23940875 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:24.584537 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-386fd9e3-c64f-4837-9230-7f8a23940875 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:24.592190 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-386fd9e3-c64f-4837-9230-7f8a23940875 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.154004 Sep 01 15:00:24.592736 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 109/205] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:24 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:25.612550 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5233b5ab-471a-4c31-9eb1-3cd6d651a7e1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:25.613165 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5233b5ab-471a-4c31-9eb1-3cd6d651a7e1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:25.620104 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5233b5ab-471a-4c31-9eb1-3cd6d651a7e1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:25.620591 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5233b5ab-471a-4c31-9eb1-3cd6d651a7e1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:25.621029 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5233b5ab-471a-4c31-9eb1-3cd6d651a7e1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:25.621713 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5233b5ab-471a-4c31-9eb1-3cd6d651a7e1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:25.622169 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5233b5ab-471a-4c31-9eb1-3cd6d651a7e1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:25.622641 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5233b5ab-471a-4c31-9eb1-3cd6d651a7e1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:25.723212 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7c3057d8-84fc-4847-85fe-cae668eb88c8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:25.723733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7c3057d8-84fc-4847-85fe-cae668eb88c8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:25.729835 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c3057d8-84fc-4847-85fe-cae668eb88c8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:25.730357 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c3057d8-84fc-4847-85fe-cae668eb88c8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:25.730798 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c3057d8-84fc-4847-85fe-cae668eb88c8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:25.731491 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c3057d8-84fc-4847-85fe-cae668eb88c8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:25.731948 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c3057d8-84fc-4847-85fe-cae668eb88c8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:25.732374 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7c3057d8-84fc-4847-85fe-cae668eb88c8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:25.748421 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-5233b5ab-471a-4c31-9eb1-3cd6d651a7e1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:25.755685 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7c3057d8-84fc-4847-85fe-cae668eb88c8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/ips" status: 200 len: 153 microversion: 2.20 time: 0.036336 Sep 01 15:00:25.756696 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5233b5ab-471a-4c31-9eb1-3cd6d651a7e1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.147973 Sep 01 15:00:25.756815 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 110/206] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Sep 1 15:00:25 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 15:00:25.757409 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 97/207] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:25 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:26.778809 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-653f3244-9791-41ba-b6bd-34915d2c503c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:26.779423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-653f3244-9791-41ba-b6bd-34915d2c503c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:26.785308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653f3244-9791-41ba-b6bd-34915d2c503c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:26.785800 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653f3244-9791-41ba-b6bd-34915d2c503c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:26.786286 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653f3244-9791-41ba-b6bd-34915d2c503c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:26.786974 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653f3244-9791-41ba-b6bd-34915d2c503c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:26.787433 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653f3244-9791-41ba-b6bd-34915d2c503c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:26.787858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653f3244-9791-41ba-b6bd-34915d2c503c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:26.914179 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-653f3244-9791-41ba-b6bd-34915d2c503c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:26.921973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-653f3244-9791-41ba-b6bd-34915d2c503c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.146993 Sep 01 15:00:26.922499 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 111/208] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:26 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:27.943456 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-623bc36e-62a1-421b-9de7-fbd0a10142dc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:27.944023 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-623bc36e-62a1-421b-9de7-fbd0a10142dc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:27.950425 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-623bc36e-62a1-421b-9de7-fbd0a10142dc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:27.950907 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-623bc36e-62a1-421b-9de7-fbd0a10142dc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:27.951340 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-623bc36e-62a1-421b-9de7-fbd0a10142dc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:27.952027 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-623bc36e-62a1-421b-9de7-fbd0a10142dc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:27.952481 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-623bc36e-62a1-421b-9de7-fbd0a10142dc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:27.952906 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-623bc36e-62a1-421b-9de7-fbd0a10142dc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:28.084007 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-623bc36e-62a1-421b-9de7-fbd0a10142dc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:28.092272 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-623bc36e-62a1-421b-9de7-fbd0a10142dc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.152719 Sep 01 15:00:28.092825 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 98/209] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:27 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:29.112910 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-fc5598e4-f3ae-4432-8e40-42c75232955c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:29.113526 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-fc5598e4-f3ae-4432-8e40-42c75232955c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:29.120053 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fc5598e4-f3ae-4432-8e40-42c75232955c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:29.120534 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fc5598e4-f3ae-4432-8e40-42c75232955c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:29.120968 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fc5598e4-f3ae-4432-8e40-42c75232955c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:29.121655 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fc5598e4-f3ae-4432-8e40-42c75232955c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:29.122109 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fc5598e4-f3ae-4432-8e40-42c75232955c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:29.122569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fc5598e4-f3ae-4432-8e40-42c75232955c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:29.249622 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-fc5598e4-f3ae-4432-8e40-42c75232955c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:29.257349 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-fc5598e4-f3ae-4432-8e40-42c75232955c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.148329 Sep 01 15:00:29.257906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 112/210] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:29 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:30.277852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9d60f9b8-2c0c-4a6c-9471-5d0f27752670 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:30.278504 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9d60f9b8-2c0c-4a6c-9471-5d0f27752670 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:30.285053 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d60f9b8-2c0c-4a6c-9471-5d0f27752670 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:30.285535 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d60f9b8-2c0c-4a6c-9471-5d0f27752670 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:30.285967 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d60f9b8-2c0c-4a6c-9471-5d0f27752670 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:30.286710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d60f9b8-2c0c-4a6c-9471-5d0f27752670 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:30.287681 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d60f9b8-2c0c-4a6c-9471-5d0f27752670 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:30.288130 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d60f9b8-2c0c-4a6c-9471-5d0f27752670 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:30.564394 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9d60f9b8-2c0c-4a6c-9471-5d0f27752670 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:30.572066 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9d60f9b8-2c0c-4a6c-9471-5d0f27752670 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.298080 Sep 01 15:00:30.572611 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 99/211] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:30 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:31.592420 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7e90b447-acc4-4049-8325-07148561cc4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:31.593039 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7e90b447-acc4-4049-8325-07148561cc4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:31.598999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e90b447-acc4-4049-8325-07148561cc4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:31.599483 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e90b447-acc4-4049-8325-07148561cc4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:31.600585 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e90b447-acc4-4049-8325-07148561cc4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:31.601284 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e90b447-acc4-4049-8325-07148561cc4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:31.601747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e90b447-acc4-4049-8325-07148561cc4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:31.602173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e90b447-acc4-4049-8325-07148561cc4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:31.733577 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-7e90b447-acc4-4049-8325-07148561cc4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:31.741453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7e90b447-acc4-4049-8325-07148561cc4a tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.152908 Sep 01 15:00:31.742010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 113/212] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:31 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:32.763817 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ab3b83bf-a676-4e60-9997-d5593931b3d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:32.764796 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ab3b83bf-a676-4e60-9997-d5593931b3d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:32.773959 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab3b83bf-a676-4e60-9997-d5593931b3d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:32.774488 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab3b83bf-a676-4e60-9997-d5593931b3d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:32.774973 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab3b83bf-a676-4e60-9997-d5593931b3d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:32.775704 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab3b83bf-a676-4e60-9997-d5593931b3d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:32.776168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab3b83bf-a676-4e60-9997-d5593931b3d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:32.776753 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab3b83bf-a676-4e60-9997-d5593931b3d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:32.910074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ab3b83bf-a676-4e60-9997-d5593931b3d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:32.918510 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ab3b83bf-a676-4e60-9997-d5593931b3d6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.158629 Sep 01 15:00:32.919069 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 100/213] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:32 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:32.938116 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6c09513f-3b60-46fa-93a3-19937e3bf9d7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:32.938699 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6c09513f-3b60-46fa-93a3-19937e3bf9d7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:32.944502 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6c09513f-3b60-46fa-93a3-19937e3bf9d7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:32.944991 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6c09513f-3b60-46fa-93a3-19937e3bf9d7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:32.945433 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6c09513f-3b60-46fa-93a3-19937e3bf9d7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:32.946132 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6c09513f-3b60-46fa-93a3-19937e3bf9d7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:32.946653 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6c09513f-3b60-46fa-93a3-19937e3bf9d7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:32.947082 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6c09513f-3b60-46fa-93a3-19937e3bf9d7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:32.970209 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-6c09513f-3b60-46fa-93a3-19937e3bf9d7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lazy-loading 'flavor' on Instance uuid 2570eed9-40bd-40ef-92d6-63b4e3cc83bf {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:00:33.166657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6c09513f-3b60-46fa-93a3-19937e3bf9d7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "POST /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/action" status: 202 len: 0 microversion: 2.20 time: 0.232108 Sep 01 15:00:33.167249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 114/214] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Sep 1 15:00:32 2022] POST /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:00:33.175672 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:33.176277 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:33.182922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:33.183409 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:33.183843 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:33.184527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:33.184979 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:33.185398 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:33.321123 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:33.329818 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:33.331421 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:33.332601 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b11fc27b-007f-41f1-b70c-74b6cc22f7ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.160836 Sep 01 15:00:33.333135 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 101/215] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:33 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:00:33.940615 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-76e91e72-f6d5-4a47-a58e-d371869a60bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:33.941502 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-76e91e72-f6d5-4a47-a58e-d371869a60bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:33.948671 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76e91e72-f6d5-4a47-a58e-d371869a60bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:33.949336 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76e91e72-f6d5-4a47-a58e-d371869a60bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:33.949785 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76e91e72-f6d5-4a47-a58e-d371869a60bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:33.950528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76e91e72-f6d5-4a47-a58e-d371869a60bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:33.950989 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76e91e72-f6d5-4a47-a58e-d371869a60bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:33.951417 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76e91e72-f6d5-4a47-a58e-d371869a60bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:34.092817 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-76e91e72-f6d5-4a47-a58e-d371869a60bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:34.101998 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-76e91e72-f6d5-4a47-a58e-d371869a60bd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.165344 Sep 01 15:00:34.102157 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 115/216] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:33 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:34.241730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9eff90e8-1732-4d68-8389-e5f515acaf90 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:34.242360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9eff90e8-1732-4d68-8389-e5f515acaf90 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:34.248951 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9eff90e8-1732-4d68-8389-e5f515acaf90 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:34.249436 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9eff90e8-1732-4d68-8389-e5f515acaf90 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:34.249865 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9eff90e8-1732-4d68-8389-e5f515acaf90 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:34.250587 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9eff90e8-1732-4d68-8389-e5f515acaf90 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:34.251227 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9eff90e8-1732-4d68-8389-e5f515acaf90 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:34.251672 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9eff90e8-1732-4d68-8389-e5f515acaf90 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:34.274949 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9eff90e8-1732-4d68-8389-e5f515acaf90 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/ips" status: 200 len: 147 microversion: 2.1 time: 0.037699 Sep 01 15:00:34.275826 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 102/217] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 1 15:00:34 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:00:34.356256 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:34.356957 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:34.362915 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:34.363467 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:34.363971 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:34.364724 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:34.365870 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:34.366407 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:34.370485 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:34.498701 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:34.508521 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:34.510004 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:34.511242 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-dbede709-48e9-4c4a-8526-b3376a72dc4d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.158810 Sep 01 15:00:34.511879 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 116/218] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:34 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:35.123018 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1b5faf65-68bf-49f5-a9ff-d0d54669d3f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:35.123852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-1b5faf65-68bf-49f5-a9ff-d0d54669d3f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:35.133114 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b5faf65-68bf-49f5-a9ff-d0d54669d3f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:35.133877 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b5faf65-68bf-49f5-a9ff-d0d54669d3f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:35.134561 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b5faf65-68bf-49f5-a9ff-d0d54669d3f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:35.135438 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b5faf65-68bf-49f5-a9ff-d0d54669d3f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:35.136050 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b5faf65-68bf-49f5-a9ff-d0d54669d3f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:35.136776 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b5faf65-68bf-49f5-a9ff-d0d54669d3f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:35.278660 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1b5faf65-68bf-49f5-a9ff-d0d54669d3f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:35.286404 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-1b5faf65-68bf-49f5-a9ff-d0d54669d3f1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.167294 Sep 01 15:00:35.286956 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 103/219] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:35 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:35.533758 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:35.534408 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:35.537967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=34 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:35.542009 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:35.542717 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:35.543313 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:35.544012 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:35.544632 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:35.545056 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:35.763176 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:35.775264 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:35.776827 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:35.778701 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cb66bbef-83c7-4f67-8f0d-fa3bd7b93a85 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.248729 Sep 01 15:00:35.780120 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 117/220] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:35 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:36.309103 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c1b077e3-b363-4aa3-ab60-df180d534e4e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:36.309885 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c1b077e3-b363-4aa3-ab60-df180d534e4e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:36.324459 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c1b077e3-b363-4aa3-ab60-df180d534e4e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:36.325394 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c1b077e3-b363-4aa3-ab60-df180d534e4e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:36.327355 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c1b077e3-b363-4aa3-ab60-df180d534e4e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:36.330701 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c1b077e3-b363-4aa3-ab60-df180d534e4e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:36.331533 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c1b077e3-b363-4aa3-ab60-df180d534e4e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:36.333149 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c1b077e3-b363-4aa3-ab60-df180d534e4e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:36.485439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c1b077e3-b363-4aa3-ab60-df180d534e4e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:36.494401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c1b077e3-b363-4aa3-ab60-df180d534e4e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.190277 Sep 01 15:00:36.495372 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 104/221] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:36 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:36.803470 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:36.804084 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:36.810728 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:36.811381 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:36.811824 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:36.812547 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:36.813181 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:36.813586 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:36.890754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-59ff9e8b-a440-44a9-ba93-051d8dc8da7f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34d54732-ac09-4332-91d7-f535fe3a2003"}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:36.893176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-59ff9e8b-a440-44a9-ba93-051d8dc8da7f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:36.899868 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-59ff9e8b-a440-44a9-ba93-051d8dc8da7f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:36.900356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-59ff9e8b-a440-44a9-ba93-051d8dc8da7f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:36.900792 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-59ff9e8b-a440-44a9-ba93-051d8dc8da7f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:36.901484 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-59ff9e8b-a440-44a9-ba93-051d8dc8da7f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:36.901936 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-59ff9e8b-a440-44a9-ba93-051d8dc8da7f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:36.902393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-59ff9e8b-a440-44a9-ba93-051d8dc8da7f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:37.026644 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:37.034715 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:37.036230 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:37.038136 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b3900a26-6525-4c9a-9cd7-08280235d2a7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.238968 Sep 01 15:00:37.038712 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 118/222] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:36 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:37.145818 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=100 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:37.282659 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-59ff9e8b-a440-44a9-ba93-051d8dc8da7f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "POST /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395796 Sep 01 15:00:37.283246 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 105/223] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:00:36 2022] POST /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/os-volume_attachments => generated 194 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:00:37.516427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-980f740f-5efe-4fb0-a81e-b7ccac74d3be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:37.517344 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-980f740f-5efe-4fb0-a81e-b7ccac74d3be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:37.523504 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-980f740f-5efe-4fb0-a81e-b7ccac74d3be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:37.523999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-980f740f-5efe-4fb0-a81e-b7ccac74d3be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:37.524435 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-980f740f-5efe-4fb0-a81e-b7ccac74d3be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:37.525129 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-980f740f-5efe-4fb0-a81e-b7ccac74d3be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:37.525574 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-980f740f-5efe-4fb0-a81e-b7ccac74d3be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:37.526156 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-980f740f-5efe-4fb0-a81e-b7ccac74d3be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:37.741785 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-980f740f-5efe-4fb0-a81e-b7ccac74d3be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:37.753132 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-980f740f-5efe-4fb0-a81e-b7ccac74d3be tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.240690 Sep 01 15:00:37.767311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 119/224] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:37 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:37.863476 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1253201373", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "networks": [{"uuid": "8585d291-02d8-4ee1-8d61-d320904eefd6"}]}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:37.916022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.network.neutron [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] validate_networks() for [('8585d291-02d8-4ee1-8d61-d320904eefd6', None, None, None, None, None)] {{(pid=120554) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:00:38.060810 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:38.061427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:38.074890 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:38.075304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:38.075756 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:38.076447 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:38.076902 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:38.077321 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:38.211920 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:38.220092 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:38.221593 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:38.222889 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c9dda3b5-ab08-47a3-82b5-ad4d1fc207d0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.165938 Sep 01 15:00:38.223436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 120/225] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:38 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:00:38.267080 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Flavor limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:00:38.267499 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Image limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:00:38.267994 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Flavor pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:00:38.268397 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Image pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:00:38.268800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:00:38.278037 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:38.278557 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:38.278987 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:38.279700 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:38.280177 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:38.280597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:38.297426 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Getting quotas for project ba5a5ea6aa4b4736ae49915583626e18. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:00:38.301291 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Getting quotas for user 534901c491b64bbe8bdc59776e643a78 and project ba5a5ea6aa4b4736ae49915583626e18. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:00:38.312219 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Going to run 1 instances... {{(pid=120554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:00:38.314583 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:00:38.359454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-498b3b25-edcb-431e-a93e-9a7b3e2dc01c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.500743 Sep 01 15:00:38.360286 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 106/226] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:00:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 502 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:00:38.372082 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-62f912d0-37f2-41ca-91ef-f527e16803fa tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:38.372871 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-62f912d0-37f2-41ca-91ef-f527e16803fa tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:38.428502 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-62f912d0-37f2-41ca-91ef-f527e16803fa tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:38.436037 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-62f912d0-37f2-41ca-91ef-f527e16803fa tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1214 microversion: 2.1 time: 0.069178 Sep 01 15:00:38.436596 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 121/227] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:38 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:38.777104 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d7fcd1bb-3b59-4a7c-bb52-4b2b5015498d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:38.777823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d7fcd1bb-3b59-4a7c-bb52-4b2b5015498d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:38.784606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d7fcd1bb-3b59-4a7c-bb52-4b2b5015498d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:38.785259 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d7fcd1bb-3b59-4a7c-bb52-4b2b5015498d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:38.785789 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d7fcd1bb-3b59-4a7c-bb52-4b2b5015498d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:38.786596 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d7fcd1bb-3b59-4a7c-bb52-4b2b5015498d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:38.787083 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d7fcd1bb-3b59-4a7c-bb52-4b2b5015498d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:38.787529 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d7fcd1bb-3b59-4a7c-bb52-4b2b5015498d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:38.914993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d7fcd1bb-3b59-4a7c-bb52-4b2b5015498d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:38.922658 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d7fcd1bb-3b59-4a7c-bb52-4b2b5015498d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.149866 Sep 01 15:00:38.923223 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 107/228] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:38 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:39.245950 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:39.246586 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:39.252784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:39.253264 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:39.253698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:39.254423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:39.254880 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:39.255306 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:39.378813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:39.387035 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:39.391367 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:39.391367 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d6875a6a-c233-49e4-b58f-8ab52575d7a3 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.147639 Sep 01 15:00:39.391367 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 122/229] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:39 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:39.455948 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7913695f-b641-4596-8000-6f6a50ce366c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:39.456562 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7913695f-b641-4596-8000-6f6a50ce366c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:39.464423 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7913695f-b641-4596-8000-6f6a50ce366c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:39.464920 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7913695f-b641-4596-8000-6f6a50ce366c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:39.465355 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7913695f-b641-4596-8000-6f6a50ce366c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:39.466050 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7913695f-b641-4596-8000-6f6a50ce366c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:39.466548 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7913695f-b641-4596-8000-6f6a50ce366c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:39.466974 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7913695f-b641-4596-8000-6f6a50ce366c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:39.524928 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7913695f-b641-4596-8000-6f6a50ce366c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:39.532377 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7913695f-b641-4596-8000-6f6a50ce366c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1218 microversion: 2.1 time: 0.080209 Sep 01 15:00:39.532935 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 108/230] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:39 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:39.944088 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a57f45e9-4c78-466d-a0a2-491afca7a39c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:39.944697 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a57f45e9-4c78-466d-a0a2-491afca7a39c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:39.950574 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a57f45e9-4c78-466d-a0a2-491afca7a39c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:39.951053 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a57f45e9-4c78-466d-a0a2-491afca7a39c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:39.951823 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a57f45e9-4c78-466d-a0a2-491afca7a39c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:39.952503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a57f45e9-4c78-466d-a0a2-491afca7a39c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:39.952963 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a57f45e9-4c78-466d-a0a2-491afca7a39c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:39.953384 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a57f45e9-4c78-466d-a0a2-491afca7a39c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:40.082673 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a57f45e9-4c78-466d-a0a2-491afca7a39c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:40.090893 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a57f45e9-4c78-466d-a0a2-491afca7a39c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.150947 Sep 01 15:00:40.091446 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 123/231] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:39 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:40.412467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:40.413074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:40.419463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:40.419947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:40.420440 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:40.421118 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:40.421568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:40.421989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:40.546455 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:40.553573 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5dec546f-7020-4318-b840-e7892071315e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:40.554194 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5dec546f-7020-4318-b840-e7892071315e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:40.555434 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:40.556858 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:40.558048 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-aa4fd8d0-1c3a-43a9-935c-16d23223db5c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.149460 Sep 01 15:00:40.558625 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 109/232] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:40 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:40.560898 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5dec546f-7020-4318-b840-e7892071315e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:40.560898 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5dec546f-7020-4318-b840-e7892071315e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:40.561259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5dec546f-7020-4318-b840-e7892071315e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:40.562006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5dec546f-7020-4318-b840-e7892071315e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:40.562565 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5dec546f-7020-4318-b840-e7892071315e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:40.563052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5dec546f-7020-4318-b840-e7892071315e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:40.621214 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-5dec546f-7020-4318-b840-e7892071315e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:40.628620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5dec546f-7020-4318-b840-e7892071315e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1218 microversion: 2.1 time: 0.079619 Sep 01 15:00:40.629170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 124/233] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:40 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:41.111923 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b8c4dc15-808b-4995-989f-5f3298bb11ad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:41.112570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b8c4dc15-808b-4995-989f-5f3298bb11ad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:41.114588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:41.120353 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8c4dc15-808b-4995-989f-5f3298bb11ad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.120840 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8c4dc15-808b-4995-989f-5f3298bb11ad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.121278 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8c4dc15-808b-4995-989f-5f3298bb11ad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.121964 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8c4dc15-808b-4995-989f-5f3298bb11ad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.122448 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8c4dc15-808b-4995-989f-5f3298bb11ad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.122875 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8c4dc15-808b-4995-989f-5f3298bb11ad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.250228 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b8c4dc15-808b-4995-989f-5f3298bb11ad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:41.257866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b8c4dc15-808b-4995-989f-5f3298bb11ad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1502 microversion: 2.1 time: 0.149899 Sep 01 15:00:41.258459 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 110/234] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:41 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:41.278361 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34ef5d06-e57e-453d-aac2-e53da7031544"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:41.280930 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:41.287626 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.288109 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.288544 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.289238 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.289697 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.290119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.312618 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] HTTP exception thrown: Cannot 'attach_volume' instance 7322e2bb-f39f-46ee-9193-1edd605d833f while it is in vm_state rescued Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Request method failure captured: Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: POST /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f/os-volume_attachments HTTP/1.1 Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 74 Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMidIN0JcFsmPkFozuW1JnVmhGyBAKw0aneJibf-YjO-MihBgOj2bcMNzZsVDgxifrpqibZcbsBfIaam-E-U_Accx2qFeg5B6aOKNhwHlqIN4boLjryK7job98_rcc-LVFONlHm9ujYdWfUeKbdmOrK0H2AEMxC7qHhhTMCvYvL3k1c Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 05e111f88e784eba929741c3cd250e78 Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:00:41.314305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/05e111f88e784eba929741c3cd250e78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/05e111f88e784eba929741c3cd250e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_05e111f88e784eba929741c3cd250e78", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/05e111f88e784eba929741c3cd250e78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 05e111f88e784eba929741c3cd250e78 Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-ServerRescueNegativeTestJSON-2040884132-project Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: df75151c37f74b6da7428dc290a274ff Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2040884132-project Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {"volumeAttachment": {"volumeId": "34ef5d06-e57e-453d-aac2-e53da7031544"}} Sep 01 15:00:41.315748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Cannot 'attach_volume' instance 7322e2bb-f39f-46ee-9193-1edd605d833f while it is in vm_state rescued Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'server_id': '7322e2bb-f39f-46ee-9193-1edd605d833f', 'body': {'volumeAttachment': {'volumeId': '34ef5d06-e57e-453d-aac2-e53da7031544'}}} Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7322e2bb-f39f-46ee-9193-1edd605d833f in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:00:41.316651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7322e2bb-f39f-46ee-9193-1edd605d833f while it is in vm_state rescued Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:00:41.318096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:00:41.319517 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:00:41.319517 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:00:41.319517 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7322e2bb-f39f-46ee-9193-1edd605d833f while it is in vm_state rescued Sep 01 15:00:41.319517 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:00:41.319517 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Returning 409 to user: Cannot 'attach_volume' instance 7322e2bb-f39f-46ee-9193-1edd605d833f while it is in vm_state rescued {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:00:41.319517 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-adb1cad3-fcf3-44b1-ac8a-be634be1dff8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "POST /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041370 Sep 01 15:00:41.319517 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 125/235] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:00:41 2022] POST /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 15:00:41.324726 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-404aec21-a6ff-43ce-ad2a-a20f437384bc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:41.325295 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-404aec21-a6ff-43ce-ad2a-a20f437384bc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:41.331242 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-404aec21-a6ff-43ce-ad2a-a20f437384bc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.331726 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-404aec21-a6ff-43ce-ad2a-a20f437384bc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.332164 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-404aec21-a6ff-43ce-ad2a-a20f437384bc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.332852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-404aec21-a6ff-43ce-ad2a-a20f437384bc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.333314 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-404aec21-a6ff-43ce-ad2a-a20f437384bc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.334256 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-404aec21-a6ff-43ce-ad2a-a20f437384bc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.398335 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-404aec21-a6ff-43ce-ad2a-a20f437384bc tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "POST /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f/action" status: 202 len: 0 microversion: 2.1 time: 0.077175 Sep 01 15:00:41.398951 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 111/236] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:00:41 2022] POST /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:00:41.407129 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-653d535f-6388-422e-86a8-2f5ec6191e2b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:41.407745 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-653d535f-6388-422e-86a8-2f5ec6191e2b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:41.414307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653d535f-6388-422e-86a8-2f5ec6191e2b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.414794 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653d535f-6388-422e-86a8-2f5ec6191e2b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.415229 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653d535f-6388-422e-86a8-2f5ec6191e2b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.415910 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653d535f-6388-422e-86a8-2f5ec6191e2b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.416367 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653d535f-6388-422e-86a8-2f5ec6191e2b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.416791 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-653d535f-6388-422e-86a8-2f5ec6191e2b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.540820 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-653d535f-6388-422e-86a8-2f5ec6191e2b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:41.548766 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-653d535f-6388-422e-86a8-2f5ec6191e2b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1510 microversion: 2.1 time: 0.145492 Sep 01 15:00:41.549337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 126/237] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:41 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:41.581985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:41.582821 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:41.589944 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.590467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.590915 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.591601 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.592064 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.592835 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.649710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-0d7362f6-bcf3-474f-9cc2-31d87ef3ec23 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:41.650355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-0d7362f6-bcf3-474f-9cc2-31d87ef3ec23 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:41.656285 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0d7362f6-bcf3-474f-9cc2-31d87ef3ec23 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.656776 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0d7362f6-bcf3-474f-9cc2-31d87ef3ec23 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.657696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0d7362f6-bcf3-474f-9cc2-31d87ef3ec23 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.657895 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0d7362f6-bcf3-474f-9cc2-31d87ef3ec23 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:41.658378 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0d7362f6-bcf3-474f-9cc2-31d87ef3ec23 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:41.658896 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0d7362f6-bcf3-474f-9cc2-31d87ef3ec23 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:41.722258 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-0d7362f6-bcf3-474f-9cc2-31d87ef3ec23 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:41.724014 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:41.730124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-0d7362f6-bcf3-474f-9cc2-31d87ef3ec23 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1210 microversion: 2.1 time: 0.084889 Sep 01 15:00:41.730841 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 127/238] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:41 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:41.732121 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:41.733552 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:41.734772 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-94315e72-96a8-4366-b9c6-54511eba7a14 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.157552 Sep 01 15:00:41.735313 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 112/239] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:41 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:42.571711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-05bfb2eb-90a5-4e7a-b94d-7d8ee410214c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:42.572358 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-05bfb2eb-90a5-4e7a-b94d-7d8ee410214c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:42.578324 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-05bfb2eb-90a5-4e7a-b94d-7d8ee410214c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:42.578808 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-05bfb2eb-90a5-4e7a-b94d-7d8ee410214c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:42.579246 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-05bfb2eb-90a5-4e7a-b94d-7d8ee410214c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:42.579935 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-05bfb2eb-90a5-4e7a-b94d-7d8ee410214c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:42.580393 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-05bfb2eb-90a5-4e7a-b94d-7d8ee410214c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:42.580819 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-05bfb2eb-90a5-4e7a-b94d-7d8ee410214c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:42.707504 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-05bfb2eb-90a5-4e7a-b94d-7d8ee410214c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:42.715096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-05bfb2eb-90a5-4e7a-b94d-7d8ee410214c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1510 microversion: 2.1 time: 0.147696 Sep 01 15:00:42.715659 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 128/240] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:42 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:42.750750 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5b98df15-6851-481a-9d89-635199e08be6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:42.751446 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5b98df15-6851-481a-9d89-635199e08be6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:42.757141 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:42.757757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:42.758519 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5b98df15-6851-481a-9d89-635199e08be6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:42.759004 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5b98df15-6851-481a-9d89-635199e08be6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:42.759437 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5b98df15-6851-481a-9d89-635199e08be6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:42.760124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5b98df15-6851-481a-9d89-635199e08be6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:42.760576 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5b98df15-6851-481a-9d89-635199e08be6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:42.760997 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5b98df15-6851-481a-9d89-635199e08be6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:42.763633 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:42.764118 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:42.764559 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:42.765248 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:42.765707 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:42.766131 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:42.821058 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-5b98df15-6851-481a-9d89-635199e08be6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:42.828860 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5b98df15-6851-481a-9d89-635199e08be6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1210 microversion: 2.1 time: 0.081781 Sep 01 15:00:42.829373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 113/241] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:42 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:42.890067 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:42.898033 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:42.899554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:42.900707 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-dae1d586-5e3b-4e6b-ad15-d5359a6309a2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.147906 Sep 01 15:00:42.901255 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 129/242] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:42 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:00:43.735767 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-efcd9d0b-46b9-4c8d-84a7-7cd00013d8f3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:43.736439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-efcd9d0b-46b9-4c8d-84a7-7cd00013d8f3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:43.742701 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-efcd9d0b-46b9-4c8d-84a7-7cd00013d8f3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:43.743184 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-efcd9d0b-46b9-4c8d-84a7-7cd00013d8f3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:43.743648 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-efcd9d0b-46b9-4c8d-84a7-7cd00013d8f3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:43.744350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-efcd9d0b-46b9-4c8d-84a7-7cd00013d8f3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:43.744805 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-efcd9d0b-46b9-4c8d-84a7-7cd00013d8f3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:43.745232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-efcd9d0b-46b9-4c8d-84a7-7cd00013d8f3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:43.848807 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7ecc920f-52ed-453f-a22b-2953985e9fcd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:43.849407 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7ecc920f-52ed-453f-a22b-2953985e9fcd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:43.855320 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7ecc920f-52ed-453f-a22b-2953985e9fcd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:43.855803 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7ecc920f-52ed-453f-a22b-2953985e9fcd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:43.856230 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7ecc920f-52ed-453f-a22b-2953985e9fcd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:43.856912 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7ecc920f-52ed-453f-a22b-2953985e9fcd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:43.857365 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7ecc920f-52ed-453f-a22b-2953985e9fcd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:43.857785 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7ecc920f-52ed-453f-a22b-2953985e9fcd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:43.873989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-efcd9d0b-46b9-4c8d-84a7-7cd00013d8f3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:43.882276 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-efcd9d0b-46b9-4c8d-84a7-7cd00013d8f3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1510 microversion: 2.1 time: 0.149841 Sep 01 15:00:43.882837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 114/243] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:43 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:43.919911 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-7ecc920f-52ed-453f-a22b-2953985e9fcd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:43.922925 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:43.923544 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:43.927782 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7ecc920f-52ed-453f-a22b-2953985e9fcd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1210 microversion: 2.1 time: 0.082807 Sep 01 15:00:43.928388 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 130/244] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:43 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:43.929781 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:43.930287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:43.930777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:43.931498 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:43.931951 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:43.932376 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:44.057775 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:44.066054 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:44.067528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:44.068686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9cd1a9c6-9f72-4454-aa45-a6f297acc863 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.149715 Sep 01 15:00:44.077617 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 115/245] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:43 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:44.903462 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e3efd75a-d1b5-4526-a349-5f060aac21eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:44.904082 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e3efd75a-d1b5-4526-a349-5f060aac21eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:44.910040 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e3efd75a-d1b5-4526-a349-5f060aac21eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:44.910560 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e3efd75a-d1b5-4526-a349-5f060aac21eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:44.910993 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e3efd75a-d1b5-4526-a349-5f060aac21eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:44.911912 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e3efd75a-d1b5-4526-a349-5f060aac21eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:44.912444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e3efd75a-d1b5-4526-a349-5f060aac21eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:44.913436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e3efd75a-d1b5-4526-a349-5f060aac21eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:44.948212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-053a2d4d-c348-4c5a-b548-087dfff05d8d tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:44.948833 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-053a2d4d-c348-4c5a-b548-087dfff05d8d tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:44.956599 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-053a2d4d-c348-4c5a-b548-087dfff05d8d tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:44.957727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-053a2d4d-c348-4c5a-b548-087dfff05d8d tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:44.958179 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-053a2d4d-c348-4c5a-b548-087dfff05d8d tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:44.958917 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-053a2d4d-c348-4c5a-b548-087dfff05d8d tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:44.959383 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-053a2d4d-c348-4c5a-b548-087dfff05d8d tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:44.960390 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-053a2d4d-c348-4c5a-b548-087dfff05d8d tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:45.021760 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-053a2d4d-c348-4c5a-b548-087dfff05d8d tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:45.029979 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-053a2d4d-c348-4c5a-b548-087dfff05d8d tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1266 microversion: 2.1 time: 0.085742 Sep 01 15:00:45.030571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 116/246] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:44 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:45.047282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e3efd75a-d1b5-4526-a349-5f060aac21eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:45.055231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e3efd75a-d1b5-4526-a349-5f060aac21eb tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1510 microversion: 2.1 time: 0.155581 Sep 01 15:00:45.055789 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 131/247] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:44 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:45.091976 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:45.092605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:45.098999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:45.099584 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:45.101108 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:45.102430 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:45.103152 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:45.103869 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:45.251098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:45.270213 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:45.271716 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:45.273523 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0118bbca-f573-4f9c-bdc1-01e2629604c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.185528 Sep 01 15:00:45.274071 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 117/248] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:45 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:46.051212 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-210912f4-d714-4969-b672-88e8bee237b7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:46.052678 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-210912f4-d714-4969-b672-88e8bee237b7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:46.059552 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-210912f4-d714-4969-b672-88e8bee237b7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:46.060253 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-210912f4-d714-4969-b672-88e8bee237b7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:46.060765 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-210912f4-d714-4969-b672-88e8bee237b7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:46.061531 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-210912f4-d714-4969-b672-88e8bee237b7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:46.061997 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-210912f4-d714-4969-b672-88e8bee237b7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:46.062458 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-210912f4-d714-4969-b672-88e8bee237b7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:46.075873 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-bda5b314-3c40-44e0-9016-829c2253fdd0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:46.076494 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-bda5b314-3c40-44e0-9016-829c2253fdd0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:46.082873 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bda5b314-3c40-44e0-9016-829c2253fdd0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:46.083359 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bda5b314-3c40-44e0-9016-829c2253fdd0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:46.083832 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bda5b314-3c40-44e0-9016-829c2253fdd0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:46.084522 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bda5b314-3c40-44e0-9016-829c2253fdd0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:46.084979 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bda5b314-3c40-44e0-9016-829c2253fdd0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:46.085407 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bda5b314-3c40-44e0-9016-829c2253fdd0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:46.124118 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-210912f4-d714-4969-b672-88e8bee237b7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:46.133046 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-210912f4-d714-4969-b672-88e8bee237b7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1274 microversion: 2.1 time: 0.084804 Sep 01 15:00:46.133934 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 132/249] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:46 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:46.215965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-bda5b314-3c40-44e0-9016-829c2253fdd0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:46.223674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-bda5b314-3c40-44e0-9016-829c2253fdd0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1510 microversion: 2.1 time: 0.151602 Sep 01 15:00:46.224233 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 118/250] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:46 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:46.296748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:46.297382 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:46.304251 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:46.304675 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:46.305113 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:46.305805 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:46.306282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:46.306711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:46.438640 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:46.446898 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:46.448382 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:46.449541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d3431772-2bb0-40f5-a10b-25fddcecae0e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.156660 Sep 01 15:00:46.450150 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 133/251] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:46 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:47.153451 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-088ed667-ee82-4205-b5d2-8cf1a1d0661c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:47.154072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-088ed667-ee82-4205-b5d2-8cf1a1d0661c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:47.160548 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-088ed667-ee82-4205-b5d2-8cf1a1d0661c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:47.161034 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-088ed667-ee82-4205-b5d2-8cf1a1d0661c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:47.161469 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-088ed667-ee82-4205-b5d2-8cf1a1d0661c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:47.162159 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-088ed667-ee82-4205-b5d2-8cf1a1d0661c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:47.162648 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-088ed667-ee82-4205-b5d2-8cf1a1d0661c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:47.163072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-088ed667-ee82-4205-b5d2-8cf1a1d0661c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:47.223813 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-088ed667-ee82-4205-b5d2-8cf1a1d0661c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:47.231345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-088ed667-ee82-4205-b5d2-8cf1a1d0661c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1274 microversion: 2.1 time: 0.081792 Sep 01 15:00:47.231883 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 119/252] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:47 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:47.245298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4b19e45f-3abd-4c8f-86e3-9b84f2919433 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:47.245913 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4b19e45f-3abd-4c8f-86e3-9b84f2919433 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:47.251769 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b19e45f-3abd-4c8f-86e3-9b84f2919433 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:47.252249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b19e45f-3abd-4c8f-86e3-9b84f2919433 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:47.252688 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b19e45f-3abd-4c8f-86e3-9b84f2919433 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:47.253370 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b19e45f-3abd-4c8f-86e3-9b84f2919433 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:47.253826 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b19e45f-3abd-4c8f-86e3-9b84f2919433 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:47.254278 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4b19e45f-3abd-4c8f-86e3-9b84f2919433 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:47.258639 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=100 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:47.380363 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4b19e45f-3abd-4c8f-86e3-9b84f2919433 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:47.388682 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4b19e45f-3abd-4c8f-86e3-9b84f2919433 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1510 microversion: 2.1 time: 0.147648 Sep 01 15:00:47.389245 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 134/253] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:47 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:47.472174 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:47.472798 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:47.478816 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:47.479297 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:47.479726 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:47.480404 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:47.480849 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:47.481272 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:47.608510 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:47.617197 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:47.618664 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:47.619814 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b8107b3f-361d-4f7f-bf73-1f35c7ecd2ac tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.151483 Sep 01 15:00:47.620357 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 120/254] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:47 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:48.252153 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-38787530-4a50-4bcb-9615-6fdf513d0982 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:48.252773 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-38787530-4a50-4bcb-9615-6fdf513d0982 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:48.259208 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-38787530-4a50-4bcb-9615-6fdf513d0982 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:48.259696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-38787530-4a50-4bcb-9615-6fdf513d0982 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:48.260135 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-38787530-4a50-4bcb-9615-6fdf513d0982 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:48.260830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-38787530-4a50-4bcb-9615-6fdf513d0982 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:48.261286 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-38787530-4a50-4bcb-9615-6fdf513d0982 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:48.261714 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-38787530-4a50-4bcb-9615-6fdf513d0982 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:48.321354 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-38787530-4a50-4bcb-9615-6fdf513d0982 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:48.328838 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-38787530-4a50-4bcb-9615-6fdf513d0982 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1274 microversion: 2.1 time: 0.080522 Sep 01 15:00:48.329386 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 135/255] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:48 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:48.409483 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d1278f25-43ed-488f-a994-3cef130bf0ac tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:48.410035 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d1278f25-43ed-488f-a994-3cef130bf0ac tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:48.412454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:48.413124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=6 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:48.418713 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d1278f25-43ed-488f-a994-3cef130bf0ac tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:48.419212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d1278f25-43ed-488f-a994-3cef130bf0ac tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:48.419663 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d1278f25-43ed-488f-a994-3cef130bf0ac tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:48.420347 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d1278f25-43ed-488f-a994-3cef130bf0ac tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:48.420802 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d1278f25-43ed-488f-a994-3cef130bf0ac tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:48.421223 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d1278f25-43ed-488f-a994-3cef130bf0ac tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:48.425255 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:48.549170 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d1278f25-43ed-488f-a994-3cef130bf0ac tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:48.557060 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d1278f25-43ed-488f-a994-3cef130bf0ac tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1510 microversion: 2.1 time: 0.151441 Sep 01 15:00:48.557608 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 121/256] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:48 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:48.642161 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:48.642841 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:48.644707 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:48.650981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:48.651486 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:48.651928 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:48.652621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:48.653077 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:48.653497 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:48.787475 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:48.795651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:48.797104 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:48.798283 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-af080856-f3a6-4913-bdd2-2bdf49246992 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.159990 Sep 01 15:00:48.798838 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 136/257] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:48 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:49.351615 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-743aeca5-9a3c-41cd-8ed8-baf7924ecf70 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:49.352266 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-743aeca5-9a3c-41cd-8ed8-baf7924ecf70 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:49.358474 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-743aeca5-9a3c-41cd-8ed8-baf7924ecf70 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:49.358968 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-743aeca5-9a3c-41cd-8ed8-baf7924ecf70 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:49.359406 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-743aeca5-9a3c-41cd-8ed8-baf7924ecf70 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:49.360126 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-743aeca5-9a3c-41cd-8ed8-baf7924ecf70 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:49.360560 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-743aeca5-9a3c-41cd-8ed8-baf7924ecf70 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:49.360995 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-743aeca5-9a3c-41cd-8ed8-baf7924ecf70 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:49.427084 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-743aeca5-9a3c-41cd-8ed8-baf7924ecf70 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:49.434934 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-743aeca5-9a3c-41cd-8ed8-baf7924ecf70 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1272 microversion: 2.1 time: 0.087792 Sep 01 15:00:49.435484 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 122/258] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:49 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:49.578451 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-de746541-d1d3-437e-b58a-3609320dd62d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:49.579743 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-de746541-d1d3-437e-b58a-3609320dd62d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:49.587776 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-de746541-d1d3-437e-b58a-3609320dd62d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:49.588349 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-de746541-d1d3-437e-b58a-3609320dd62d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:49.588840 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-de746541-d1d3-437e-b58a-3609320dd62d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:49.589791 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-de746541-d1d3-437e-b58a-3609320dd62d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:49.590634 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-de746541-d1d3-437e-b58a-3609320dd62d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:49.591327 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-de746541-d1d3-437e-b58a-3609320dd62d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:49.822769 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:49.823476 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:49.829635 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:49.830197 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:49.830738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:49.831536 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:49.832058 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:49.832169 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-de746541-d1d3-437e-b58a-3609320dd62d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:49.832613 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:49.840487 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-de746541-d1d3-437e-b58a-3609320dd62d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1516 microversion: 2.1 time: 0.266127 Sep 01 15:00:49.841124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 137/259] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:49 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1516 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:49.976898 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:49.996692 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:49.999819 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:50.001173 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-dbc436a9-2880-4d3b-802e-d4e0fec4b603 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.183861 Sep 01 15:00:50.002046 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 123/260] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:49 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:50.455968 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-285433eb-9761-4001-ba10-6b68737aba06 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:50.456609 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-285433eb-9761-4001-ba10-6b68737aba06 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:50.464172 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-285433eb-9761-4001-ba10-6b68737aba06 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:50.464672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-285433eb-9761-4001-ba10-6b68737aba06 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:50.465112 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-285433eb-9761-4001-ba10-6b68737aba06 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:50.465812 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-285433eb-9761-4001-ba10-6b68737aba06 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:50.466304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-285433eb-9761-4001-ba10-6b68737aba06 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:50.466767 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-285433eb-9761-4001-ba10-6b68737aba06 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:50.667267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-285433eb-9761-4001-ba10-6b68737aba06 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:50.675052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-285433eb-9761-4001-ba10-6b68737aba06 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1314 microversion: 2.1 time: 0.223309 Sep 01 15:00:50.675615 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 138/261] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:50 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:50.744597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-c4de3309-f6ed-4c9b-9727-fa23a013e4ae req-36b14914-26d5-4b51-9ac3-728fe9164e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00b27769-efab-4939-913d-cb3119257046", "tag": "51c60c03-13c0-4a16-91e7-7348d177b947"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:50.756746 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-c4de3309-f6ed-4c9b-9727-fa23a013e4ae req-36b14914-26d5-4b51-9ac3-728fe9164e83 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:50.757345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-c4de3309-f6ed-4c9b-9727-fa23a013e4ae req-36b14914-26d5-4b51-9ac3-728fe9164e83 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:50.757859 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-c4de3309-f6ed-4c9b-9727-fa23a013e4ae req-36b14914-26d5-4b51-9ac3-728fe9164e83 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:50.772035 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-c4de3309-f6ed-4c9b-9727-fa23a013e4ae req-36b14914-26d5-4b51-9ac3-728fe9164e83 service nova] Creating event network-changed:51c60c03-13c0-4a16-91e7-7348d177b947 for instance 00b27769-efab-4939-913d-cb3119257046 on hv-cinder-85505 Sep 01 15:00:50.780763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-c4de3309-f6ed-4c9b-9727-fa23a013e4ae req-36b14914-26d5-4b51-9ac3-728fe9164e83 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039606 Sep 01 15:00:50.781485 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 124/262] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:00:51.034636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:51.035797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:51.060222 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:51.061624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:51.063223 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:51.070037 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:51.071579 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:51.072615 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:51.204873 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-63225249-dfe8-4e32-8a64-3dcec5566def tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:51.211782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-63225249-dfe8-4e32-8a64-3dcec5566def tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:51.212151 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-63225249-dfe8-4e32-8a64-3dcec5566def tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:51.212626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-63225249-dfe8-4e32-8a64-3dcec5566def tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:51.274561 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-63225249-dfe8-4e32-8a64-3dcec5566def tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Going to try to stop instance {{(pid=120554) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 15:00:51.292129 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:51.300443 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:51.302915 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:51.305188 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-347c5134-2a58-4d31-b8d3-0addfe9af177 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.281954 Sep 01 15:00:51.305967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 139/263] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:51 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:51.310774 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-770c2987-ac39-4190-9637-5d78d59aa07e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Action: 'create', calling method: .version_select at 0x7fab73f44430>, body: {"keypair": {"name": "tempest-keypair-485175657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdAFVHHVgSqmptGn3+lMHi7/Eju0HCfy/nN7lPm9Q1kw9UpS0QZnsmLd+eRp7hi4y9fQeX5i36OishS0220ei40s2o3HuoasX4MV5URASJXeywtGfovB1PZDN9ungbA0Q=="}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:51.327312 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-63225249-dfe8-4e32-8a64-3dcec5566def tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "POST /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/action" status: 202 len: 0 microversion: 2.1 time: 0.126932 Sep 01 15:00:51.327735 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 125/264] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:00:51 2022] POST /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:00:51.329942 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-770c2987-ac39-4190-9637-5d78d59aa07e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Getting quotas for project 05e111f88e784eba929741c3cd250e78. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:00:51.337292 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c0d304a2-50a0-424b-a52c-d56282dc4fc0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:51.339020 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c0d304a2-50a0-424b-a52c-d56282dc4fc0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:51.339784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-770c2987-ac39-4190-9637-5d78d59aa07e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Getting quotas for user df75151c37f74b6da7428dc290a274ff and project 05e111f88e784eba929741c3cd250e78. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:00:51.349466 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c0d304a2-50a0-424b-a52c-d56282dc4fc0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:51.350022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c0d304a2-50a0-424b-a52c-d56282dc4fc0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:51.350985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c0d304a2-50a0-424b-a52c-d56282dc4fc0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:51.351688 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c0d304a2-50a0-424b-a52c-d56282dc4fc0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:51.352190 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c0d304a2-50a0-424b-a52c-d56282dc4fc0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:51.352826 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c0d304a2-50a0-424b-a52c-d56282dc4fc0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:51.367843 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-770c2987-ac39-4190-9637-5d78d59aa07e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060431 Sep 01 15:00:51.368435 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 140/265] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 1 15:00:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:00:51.532425 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c0d304a2-50a0-424b-a52c-d56282dc4fc0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:51.541984 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c0d304a2-50a0-424b-a52c-d56282dc4fc0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.208754 Sep 01 15:00:51.542594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 126/266] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:51 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:51.695553 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-83d8ba30-46d0-461e-958c-a9e40bd1fc34 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:51.697257 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-83d8ba30-46d0-461e-958c-a9e40bd1fc34 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:51.704021 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83d8ba30-46d0-461e-958c-a9e40bd1fc34 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:51.704599 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83d8ba30-46d0-461e-958c-a9e40bd1fc34 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:51.705045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83d8ba30-46d0-461e-958c-a9e40bd1fc34 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:51.705758 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83d8ba30-46d0-461e-958c-a9e40bd1fc34 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:51.709191 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83d8ba30-46d0-461e-958c-a9e40bd1fc34 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:51.710110 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83d8ba30-46d0-461e-958c-a9e40bd1fc34 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:51.889226 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-83d8ba30-46d0-461e-958c-a9e40bd1fc34 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:51.898612 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-83d8ba30-46d0-461e-958c-a9e40bd1fc34 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1314 microversion: 2.1 time: 0.206855 Sep 01 15:00:51.899666 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 141/267] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:51 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:52.329017 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:52.329759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:52.337219 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:52.337715 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:52.338155 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:52.338886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:52.339345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:52.339774 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:52.564005 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6a25bd6e-4a8c-4091-896b-8d626f0006c5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:52.564733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6a25bd6e-4a8c-4091-896b-8d626f0006c5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:52.571487 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6a25bd6e-4a8c-4091-896b-8d626f0006c5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:52.572043 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6a25bd6e-4a8c-4091-896b-8d626f0006c5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:52.572563 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6a25bd6e-4a8c-4091-896b-8d626f0006c5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:52.573357 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6a25bd6e-4a8c-4091-896b-8d626f0006c5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:52.573879 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6a25bd6e-4a8c-4091-896b-8d626f0006c5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:52.574379 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6a25bd6e-4a8c-4091-896b-8d626f0006c5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:52.703745 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6a25bd6e-4a8c-4091-896b-8d626f0006c5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:52.712223 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6a25bd6e-4a8c-4091-896b-8d626f0006c5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.152066 Sep 01 15:00:52.712785 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 142/268] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:52 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:52.741215 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:52.750530 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:52.752821 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:52.754353 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-1b8a0726-4e1d-4a07-a9da-797f9c831d3b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.429078 Sep 01 15:00:52.755240 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 127/269] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:52 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:52.921127 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4fc92520-fa41-44f1-b16b-c5004c94b596 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:52.923151 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4fc92520-fa41-44f1-b16b-c5004c94b596 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:52.932967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4fc92520-fa41-44f1-b16b-c5004c94b596 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:52.934129 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4fc92520-fa41-44f1-b16b-c5004c94b596 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:52.934688 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4fc92520-fa41-44f1-b16b-c5004c94b596 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:52.935623 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4fc92520-fa41-44f1-b16b-c5004c94b596 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:52.936155 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4fc92520-fa41-44f1-b16b-c5004c94b596 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:52.936827 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4fc92520-fa41-44f1-b16b-c5004c94b596 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:53.089632 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4fc92520-fa41-44f1-b16b-c5004c94b596 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:53.098869 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4fc92520-fa41-44f1-b16b-c5004c94b596 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1314 microversion: 2.1 time: 0.182658 Sep 01 15:00:53.100593 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 143/270] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:52 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:53.443771 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2088765036", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b24b76ad-94a6-47fa-b4fa-c9e8cd11ca83"}], "security_groups": [{"name": "tempest-securitygroup--1040483017"}], "key_name": "tempest-keypair-485175657", "user_data": "}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:53.555651 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.network.neutron [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] validate_networks() for [('b24b76ad-94a6-47fa-b4fa-c9e8cd11ca83', None, None, None, None, None)] {{(pid=120554) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:00:53.733763 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-886bff3f-0992-47f4-974c-1b594ee33993 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:53.735189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-886bff3f-0992-47f4-974c-1b594ee33993 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:53.741436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-886bff3f-0992-47f4-974c-1b594ee33993 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:53.742133 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-886bff3f-0992-47f4-974c-1b594ee33993 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:53.742794 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-886bff3f-0992-47f4-974c-1b594ee33993 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:53.743467 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-886bff3f-0992-47f4-974c-1b594ee33993 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:53.743930 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-886bff3f-0992-47f4-974c-1b594ee33993 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:53.744358 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-886bff3f-0992-47f4-974c-1b594ee33993 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:53.964321 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Flavor limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:00:53.964849 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Image limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:00:53.965397 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Flavor pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:00:53.965878 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Image pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:00:53.966345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:00:53.975296 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:53.975787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:53.976226 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:53.976989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:53.977445 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:53.977873 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:53.996732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Getting quotas for project 05e111f88e784eba929741c3cd250e78. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:00:54.000965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Getting quotas for user df75151c37f74b6da7428dc290a274ff and project 05e111f88e784eba929741c3cd250e78. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:00:54.014690 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Going to run 1 instances... {{(pid=120554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:00:54.017138 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:00:54.071535 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c82cfd6d-e7ec-4a9b-86a9-f64ee6cfac29 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.631865 Sep 01 15:00:54.072558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 128/271] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:00:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:00:54.077221 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:54.078107 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:54.085030 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:54.085526 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:54.085970 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:54.086711 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:54.087174 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:54.087609 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:54.248196 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-886bff3f-0992-47f4-974c-1b594ee33993 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:54.257290 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-886bff3f-0992-47f4-974c-1b594ee33993 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.526703 Sep 01 15:00:54.264140 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 144/272] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:53 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:54.268844 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2de49792-6c75-40d3-b079-7a01c9bb4ec4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:54.272172 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2de49792-6c75-40d3-b079-7a01c9bb4ec4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:54.299731 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:54.309624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:54.311893 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:54.313176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9c7b9424-65e0-4b34-a424-6f539cdefb46 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.239610 Sep 01 15:00:54.313857 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 129/273] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:54 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:54.322567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-70bcae57-6040-425c-8a56-7ec1c39ebab2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:54.323452 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-70bcae57-6040-425c-8a56-7ec1c39ebab2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:54.330779 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70bcae57-6040-425c-8a56-7ec1c39ebab2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:54.331513 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70bcae57-6040-425c-8a56-7ec1c39ebab2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:54.332306 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70bcae57-6040-425c-8a56-7ec1c39ebab2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:54.333227 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70bcae57-6040-425c-8a56-7ec1c39ebab2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:54.333912 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70bcae57-6040-425c-8a56-7ec1c39ebab2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:54.334975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70bcae57-6040-425c-8a56-7ec1c39ebab2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:54.400856 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2de49792-6c75-40d3-b079-7a01c9bb4ec4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:54.409742 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2de49792-6c75-40d3-b079-7a01c9bb4ec4 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1245 microversion: 2.1 time: 0.144544 Sep 01 15:00:54.410817 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 145/274] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:54 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1245 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:54.554769 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-70bcae57-6040-425c-8a56-7ec1c39ebab2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:54.579662 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-70bcae57-6040-425c-8a56-7ec1c39ebab2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1314 microversion: 2.1 time: 0.264296 Sep 01 15:00:54.580397 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 130/275] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:54 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:55.284165 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e209fe0d-c875-4655-a8fb-3a49a3a77deb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:55.284851 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e209fe0d-c875-4655-a8fb-3a49a3a77deb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:55.291019 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e209fe0d-c875-4655-a8fb-3a49a3a77deb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:55.291509 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e209fe0d-c875-4655-a8fb-3a49a3a77deb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:55.291951 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e209fe0d-c875-4655-a8fb-3a49a3a77deb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:55.292648 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e209fe0d-c875-4655-a8fb-3a49a3a77deb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:55.293162 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e209fe0d-c875-4655-a8fb-3a49a3a77deb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:55.293642 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e209fe0d-c875-4655-a8fb-3a49a3a77deb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:55.339341 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:55.340446 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:55.347965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:55.348749 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:55.349202 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:55.350125 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:55.350622 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:55.351054 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:55.427896 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e209fe0d-c875-4655-a8fb-3a49a3a77deb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:55.439549 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e209fe0d-c875-4655-a8fb-3a49a3a77deb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.159217 Sep 01 15:00:55.440170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 146/276] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:55 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:55.445673 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c50030db-64c2-482e-b248-675265fce678 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:55.446326 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c50030db-64c2-482e-b248-675265fce678 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:55.453398 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c50030db-64c2-482e-b248-675265fce678 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:55.453900 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c50030db-64c2-482e-b248-675265fce678 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:55.454432 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c50030db-64c2-482e-b248-675265fce678 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:55.455195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c50030db-64c2-482e-b248-675265fce678 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:55.455687 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c50030db-64c2-482e-b248-675265fce678 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:55.456123 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c50030db-64c2-482e-b248-675265fce678 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:55.500497 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:55.509751 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:55.511260 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:55.512436 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-007c294d-a328-4853-b7f2-fd74b911ce17 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.179897 Sep 01 15:00:55.512993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 131/277] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:55 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:00:55.524695 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c50030db-64c2-482e-b248-675265fce678 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:55.534084 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c50030db-64c2-482e-b248-675265fce678 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1249 microversion: 2.1 time: 0.092717 Sep 01 15:00:55.534700 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 147/278] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:55 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:55.600388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a1a43faf-c695-44af-9269-a3d273136658 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:55.601006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a1a43faf-c695-44af-9269-a3d273136658 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:55.606960 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1a43faf-c695-44af-9269-a3d273136658 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:55.608100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1a43faf-c695-44af-9269-a3d273136658 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:55.608736 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1a43faf-c695-44af-9269-a3d273136658 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:55.609440 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1a43faf-c695-44af-9269-a3d273136658 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:55.609904 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1a43faf-c695-44af-9269-a3d273136658 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:55.610362 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a1a43faf-c695-44af-9269-a3d273136658 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:55.747355 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a1a43faf-c695-44af-9269-a3d273136658 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:55.754944 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a1a43faf-c695-44af-9269-a3d273136658 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1314 microversion: 2.1 time: 0.158378 Sep 01 15:00:55.755514 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 132/279] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:55 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:56.207946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-51621684", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "networks": [{"uuid": "6eb53885-f9c1-4edf-8b7a-302fe86a6fcc"}]}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:56.259159 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.network.neutron [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] validate_networks() for [('6eb53885-f9c1-4edf-8b7a-302fe86a6fcc', None, None, None, None, None)] {{(pid=120553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:00:56.466858 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a4328518-758e-48e3-b730-1d2aed8cd420 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:56.468143 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a4328518-758e-48e3-b730-1d2aed8cd420 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:56.479798 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4328518-758e-48e3-b730-1d2aed8cd420 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:56.479798 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4328518-758e-48e3-b730-1d2aed8cd420 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:56.479798 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4328518-758e-48e3-b730-1d2aed8cd420 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:56.480991 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4328518-758e-48e3-b730-1d2aed8cd420 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:56.481479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4328518-758e-48e3-b730-1d2aed8cd420 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:56.482055 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4328518-758e-48e3-b730-1d2aed8cd420 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:56.633202 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a4328518-758e-48e3-b730-1d2aed8cd420 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:56.644076 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a4328518-758e-48e3-b730-1d2aed8cd420 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.181405 Sep 01 15:00:56.658088 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 133/280] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:56 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:56.669274 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:56.669892 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:56.677670 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:56.678303 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:56.679077 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:56.680350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:56.680985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:56.681422 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:56.822747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Flavor limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:00:56.823254 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Image limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:00:56.824571 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Flavor pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:00:56.825000 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Image pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:00:56.825788 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:00:56.838278 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:56.838278 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:56.838809 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:56.839878 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:56.840444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:56.840577 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:56.840940 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:56.849352 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:56.851946 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:56.853332 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-75f37367-50ec-452d-95d0-3efb19918741 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1744 microversion: 2.20 time: 0.207813 Sep 01 15:00:56.854068 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 134/281] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:56 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1744 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:56.857936 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Getting quotas for project 53f5d57b243e421cbf8d929cafe9c860. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:00:56.859079 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c5498da1-cbe4-4f04-81ac-ea18347414d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:56.860096 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c5498da1-cbe4-4f04-81ac-ea18347414d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:56.862231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Getting quotas for user 74b4bf3f69204fc896c996bcaa9e087e and project 53f5d57b243e421cbf8d929cafe9c860. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:00:56.873710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Going to run 1 instances... {{(pid=120553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:00:56.874833 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5498da1-cbe4-4f04-81ac-ea18347414d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:56.875387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5498da1-cbe4-4f04-81ac-ea18347414d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:56.876018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:00:56.876140 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5498da1-cbe4-4f04-81ac-ea18347414d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:56.876902 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5498da1-cbe4-4f04-81ac-ea18347414d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:56.877449 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5498da1-cbe4-4f04-81ac-ea18347414d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:56.877936 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5498da1-cbe4-4f04-81ac-ea18347414d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:56.937216 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d3c1f5ee-f4b3-43fd-a870-4c2bf024fd69 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732807 Sep 01 15:00:56.944719 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 148/282] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:00:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:00:56.949975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d1eb7609-2330-42bb-add5-eca9f44d8a8e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:56.950890 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d1eb7609-2330-42bb-add5-eca9f44d8a8e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:56.954080 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c5498da1-cbe4-4f04-81ac-ea18347414d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:56.958932 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1eb7609-2330-42bb-add5-eca9f44d8a8e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:56.959852 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1eb7609-2330-42bb-add5-eca9f44d8a8e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:56.960613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1eb7609-2330-42bb-add5-eca9f44d8a8e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:56.961533 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1eb7609-2330-42bb-add5-eca9f44d8a8e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:56.962182 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1eb7609-2330-42bb-add5-eca9f44d8a8e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:56.962651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1eb7609-2330-42bb-add5-eca9f44d8a8e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:56.963666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c5498da1-cbe4-4f04-81ac-ea18347414d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1303 microversion: 2.1 time: 0.108113 Sep 01 15:00:56.976969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 135/283] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:56 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:56.976969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7b4419e1-00ad-4d38-b842-5c914da0e7bb tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:56.976969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7b4419e1-00ad-4d38-b842-5c914da0e7bb tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:57.024621 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7b4419e1-00ad-4d38-b842-5c914da0e7bb tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:57.033763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7b4419e1-00ad-4d38-b842-5c914da0e7bb tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1217 microversion: 2.1 time: 0.067787 Sep 01 15:00:57.040263 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 136/284] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:56 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:57.167230 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d1eb7609-2330-42bb-add5-eca9f44d8a8e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:57.175751 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d1eb7609-2330-42bb-add5-eca9f44d8a8e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1314 microversion: 2.1 time: 0.229563 Sep 01 15:00:57.176370 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 149/285] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:56 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:57.676926 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ac36ae50-f209-4dc2-b20d-95d30f8e7389 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:57.678217 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ac36ae50-f209-4dc2-b20d-95d30f8e7389 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:57.686577 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac36ae50-f209-4dc2-b20d-95d30f8e7389 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:57.687590 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac36ae50-f209-4dc2-b20d-95d30f8e7389 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:57.687915 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac36ae50-f209-4dc2-b20d-95d30f8e7389 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:57.688639 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac36ae50-f209-4dc2-b20d-95d30f8e7389 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:57.689268 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac36ae50-f209-4dc2-b20d-95d30f8e7389 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:57.689706 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ac36ae50-f209-4dc2-b20d-95d30f8e7389 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:57.838682 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ac36ae50-f209-4dc2-b20d-95d30f8e7389 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:57.847837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ac36ae50-f209-4dc2-b20d-95d30f8e7389 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.176825 Sep 01 15:00:57.848419 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 137/286] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:57 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:57.876379 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:57.877069 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:57.883802 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:57.884361 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:57.884863 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:57.885624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:57.886144 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:57.886815 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:57.987620 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ede60b10-5e49-4d5d-bfac-62338e8769fd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:57.988807 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ede60b10-5e49-4d5d-bfac-62338e8769fd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:57.995841 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ede60b10-5e49-4d5d-bfac-62338e8769fd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:57.996295 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ede60b10-5e49-4d5d-bfac-62338e8769fd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:57.997873 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ede60b10-5e49-4d5d-bfac-62338e8769fd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:57.999046 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ede60b10-5e49-4d5d-bfac-62338e8769fd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:57.999663 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ede60b10-5e49-4d5d-bfac-62338e8769fd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:58.000271 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ede60b10-5e49-4d5d-bfac-62338e8769fd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:58.113393 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:58.125832 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:58.127746 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:58.129477 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-390d2e14-28d6-47ef-b9f2-eaa801d062b4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1744 microversion: 2.20 time: 0.256966 Sep 01 15:00:58.145476 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 150/287] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:57 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1744 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:58.152613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-893d164a-c0e4-4e55-bfb8-51791bd86a4c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:58.153487 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-893d164a-c0e4-4e55-bfb8-51791bd86a4c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:58.163873 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893d164a-c0e4-4e55-bfb8-51791bd86a4c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:58.164491 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893d164a-c0e4-4e55-bfb8-51791bd86a4c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:58.165219 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893d164a-c0e4-4e55-bfb8-51791bd86a4c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:58.166304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893d164a-c0e4-4e55-bfb8-51791bd86a4c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:58.167052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893d164a-c0e4-4e55-bfb8-51791bd86a4c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:58.168323 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893d164a-c0e4-4e55-bfb8-51791bd86a4c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:58.180654 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ede60b10-5e49-4d5d-bfac-62338e8769fd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:58.189338 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ede60b10-5e49-4d5d-bfac-62338e8769fd tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1371 microversion: 2.1 time: 0.207929 Sep 01 15:00:58.189911 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 138/288] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:57 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:58.198006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-966fdad3-875f-43ee-ac61-679f0cf2ee51 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:58.198653 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-966fdad3-875f-43ee-ac61-679f0cf2ee51 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:58.207456 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966fdad3-875f-43ee-ac61-679f0cf2ee51 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:58.208278 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966fdad3-875f-43ee-ac61-679f0cf2ee51 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:58.208962 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966fdad3-875f-43ee-ac61-679f0cf2ee51 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:58.210497 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966fdad3-875f-43ee-ac61-679f0cf2ee51 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:58.211239 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966fdad3-875f-43ee-ac61-679f0cf2ee51 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:58.211963 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-966fdad3-875f-43ee-ac61-679f0cf2ee51 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:58.217538 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:58.325905 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-893d164a-c0e4-4e55-bfb8-51791bd86a4c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:58.337662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-893d164a-c0e4-4e55-bfb8-51791bd86a4c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1269 microversion: 2.1 time: 0.190658 Sep 01 15:00:58.351070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 151/289] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:58 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1269 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:58.388806 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-966fdad3-875f-43ee-ac61-679f0cf2ee51 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:58.398332 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-966fdad3-875f-43ee-ac61-679f0cf2ee51 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1314 microversion: 2.1 time: 0.203882 Sep 01 15:00:58.399479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 139/290] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:58 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:58.632033 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-c0326701-1b21-4e0b-aac8-a61ce52832ed req-e1c7eaed-ed92-4c83-ad3b-5c0e8ec95e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da903e65-d948-457a-8d12-9253ffeacb02", "tag": "c6295804-bbdf-4e7a-af58-cedd94bf76a7"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:00:58.641360 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-c0326701-1b21-4e0b-aac8-a61ce52832ed req-e1c7eaed-ed92-4c83-ad3b-5c0e8ec95e5f service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:58.641842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-c0326701-1b21-4e0b-aac8-a61ce52832ed req-e1c7eaed-ed92-4c83-ad3b-5c0e8ec95e5f service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:58.642295 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-c0326701-1b21-4e0b-aac8-a61ce52832ed req-e1c7eaed-ed92-4c83-ad3b-5c0e8ec95e5f service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:58.658596 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-c0326701-1b21-4e0b-aac8-a61ce52832ed req-e1c7eaed-ed92-4c83-ad3b-5c0e8ec95e5f service nova] Creating event network-changed:c6295804-bbdf-4e7a-af58-cedd94bf76a7 for instance da903e65-d948-457a-8d12-9253ffeacb02 on hv-cinder-85505 Sep 01 15:00:58.664772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-c0326701-1b21-4e0b-aac8-a61ce52832ed req-e1c7eaed-ed92-4c83-ad3b-5c0e8ec95e5f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037042 Sep 01 15:00:58.665455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 152/291] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:00:58.869730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-649a9589-2861-44fe-a85e-3c0c7abce970 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:58.870428 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-649a9589-2861-44fe-a85e-3c0c7abce970 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:58.876800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-649a9589-2861-44fe-a85e-3c0c7abce970 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:58.877290 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-649a9589-2861-44fe-a85e-3c0c7abce970 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:58.877912 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-649a9589-2861-44fe-a85e-3c0c7abce970 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:58.878749 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-649a9589-2861-44fe-a85e-3c0c7abce970 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:58.879227 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-649a9589-2861-44fe-a85e-3c0c7abce970 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:58.879707 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-649a9589-2861-44fe-a85e-3c0c7abce970 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:59.012838 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-649a9589-2861-44fe-a85e-3c0c7abce970 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:59.021218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-649a9589-2861-44fe-a85e-3c0c7abce970 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.156124 Sep 01 15:00:59.022406 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 140/292] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:58 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:59.156160 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:59.157506 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:59.159626 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:00:59.166829 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:59.167722 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:59.168454 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:59.169383 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:59.170149 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:59.170701 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:59.213592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4b3a6a47-e600-4d5f-9ddc-0aeb2c6da316 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:59.214220 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4b3a6a47-e600-4d5f-9ddc-0aeb2c6da316 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:59.224688 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4b3a6a47-e600-4d5f-9ddc-0aeb2c6da316 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:59.226086 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4b3a6a47-e600-4d5f-9ddc-0aeb2c6da316 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:59.226993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4b3a6a47-e600-4d5f-9ddc-0aeb2c6da316 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:59.228282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4b3a6a47-e600-4d5f-9ddc-0aeb2c6da316 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:59.229124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4b3a6a47-e600-4d5f-9ddc-0aeb2c6da316 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:59.230437 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4b3a6a47-e600-4d5f-9ddc-0aeb2c6da316 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:59.451720 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4b3a6a47-e600-4d5f-9ddc-0aeb2c6da316 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:59.460836 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4b3a6a47-e600-4d5f-9ddc-0aeb2c6da316 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1371 microversion: 2.1 time: 0.252149 Sep 01 15:00:59.474585 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 141/293] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:59 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:00:59.481984 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-77a6a396-8c60-4d18-a766-c6f72dd5cebf tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:59.483147 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-77a6a396-8c60-4d18-a766-c6f72dd5cebf tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:59.490755 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77a6a396-8c60-4d18-a766-c6f72dd5cebf tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:59.491567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77a6a396-8c60-4d18-a766-c6f72dd5cebf tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:59.492238 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77a6a396-8c60-4d18-a766-c6f72dd5cebf tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:59.493169 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77a6a396-8c60-4d18-a766-c6f72dd5cebf tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:59.493829 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77a6a396-8c60-4d18-a766-c6f72dd5cebf tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:59.495351 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77a6a396-8c60-4d18-a766-c6f72dd5cebf tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:59.575696 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-77a6a396-8c60-4d18-a766-c6f72dd5cebf tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:59.587409 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-77a6a396-8c60-4d18-a766-c6f72dd5cebf tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1275 microversion: 2.1 time: 0.110259 Sep 01 15:00:59.590673 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 142/294] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:59 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1275 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:00:59.600287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c7a55406-73ca-4ba5-a9e8-98eb566fe039 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:00:59.602435 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c7a55406-73ca-4ba5-a9e8-98eb566fe039 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:00:59.616869 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7a55406-73ca-4ba5-a9e8-98eb566fe039 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:59.617450 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7a55406-73ca-4ba5-a9e8-98eb566fe039 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:59.620619 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7a55406-73ca-4ba5-a9e8-98eb566fe039 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:59.621463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7a55406-73ca-4ba5-a9e8-98eb566fe039 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:00:59.622016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7a55406-73ca-4ba5-a9e8-98eb566fe039 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:00:59.622573 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c7a55406-73ca-4ba5-a9e8-98eb566fe039 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:00:59.682114 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:59.694489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:59.696396 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:59.697924 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d90344da-3410-4848-a0e5-211fb9419857 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1744 microversion: 2.20 time: 0.546112 Sep 01 15:00:59.710997 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 153/295] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:00:59 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1744 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:00:59.832766 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c7a55406-73ca-4ba5-a9e8-98eb566fe039 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:00:59.857269 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c7a55406-73ca-4ba5-a9e8-98eb566fe039 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1314 microversion: 2.1 time: 0.260780 Sep 01 15:00:59.858014 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 143/296] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:00:59 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:00.045421 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-306d3373-fcc2-4246-8548-f79908acb7e1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:00.046089 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-306d3373-fcc2-4246-8548-f79908acb7e1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:00.053927 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-306d3373-fcc2-4246-8548-f79908acb7e1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:00.066029 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-306d3373-fcc2-4246-8548-f79908acb7e1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:00.066570 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-306d3373-fcc2-4246-8548-f79908acb7e1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:00.067332 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-306d3373-fcc2-4246-8548-f79908acb7e1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:00.067814 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-306d3373-fcc2-4246-8548-f79908acb7e1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:00.068243 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-306d3373-fcc2-4246-8548-f79908acb7e1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:00.074140 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=100 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:00.262312 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-0522ad9f-9db8-4165-97f0-17bb364dd05b req-5b7444ab-9389-41b1-a510-3a017e008486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b27769-efab-4939-913d-cb3119257046", "name": "network-vif-plugged", "status": "completed", "tag": "51c60c03-13c0-4a16-91e7-7348d177b947"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:00.283062 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-0522ad9f-9db8-4165-97f0-17bb364dd05b req-5b7444ab-9389-41b1-a510-3a017e008486 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:00.283552 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-0522ad9f-9db8-4165-97f0-17bb364dd05b req-5b7444ab-9389-41b1-a510-3a017e008486 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:00.283990 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-0522ad9f-9db8-4165-97f0-17bb364dd05b req-5b7444ab-9389-41b1-a510-3a017e008486 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:00.313898 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-0522ad9f-9db8-4165-97f0-17bb364dd05b req-5b7444ab-9389-41b1-a510-3a017e008486 service nova] Creating event network-vif-plugged:51c60c03-13c0-4a16-91e7-7348d177b947 for instance 00b27769-efab-4939-913d-cb3119257046 on hv-cinder-85505 Sep 01 15:01:00.323537 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-0522ad9f-9db8-4165-97f0-17bb364dd05b req-5b7444ab-9389-41b1-a510-3a017e008486 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064650 Sep 01 15:01:00.324144 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 144/297] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:01:00.483010 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e095bd02-bfbe-4bd8-b7b2-5197162f1543 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:00.483711 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e095bd02-bfbe-4bd8-b7b2-5197162f1543 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:00.497378 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e095bd02-bfbe-4bd8-b7b2-5197162f1543 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:00.499709 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e095bd02-bfbe-4bd8-b7b2-5197162f1543 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:00.500280 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e095bd02-bfbe-4bd8-b7b2-5197162f1543 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:00.501031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e095bd02-bfbe-4bd8-b7b2-5197162f1543 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:00.501505 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e095bd02-bfbe-4bd8-b7b2-5197162f1543 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:00.508997 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e095bd02-bfbe-4bd8-b7b2-5197162f1543 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:00.578969 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-306d3373-fcc2-4246-8548-f79908acb7e1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:00.596331 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-306d3373-fcc2-4246-8548-f79908acb7e1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.557186 Sep 01 15:01:00.598126 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 154/298] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:00 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:00.612126 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-3d51ad7f-82bd-438b-9ac7-6ffb031ff84c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:00.615039 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-3d51ad7f-82bd-438b-9ac7-6ffb031ff84c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:00.625346 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d51ad7f-82bd-438b-9ac7-6ffb031ff84c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:00.625840 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d51ad7f-82bd-438b-9ac7-6ffb031ff84c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:00.628434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d51ad7f-82bd-438b-9ac7-6ffb031ff84c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:00.629199 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d51ad7f-82bd-438b-9ac7-6ffb031ff84c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:00.629670 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d51ad7f-82bd-438b-9ac7-6ffb031ff84c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:00.630104 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d51ad7f-82bd-438b-9ac7-6ffb031ff84c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:00.758805 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e095bd02-bfbe-4bd8-b7b2-5197162f1543 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:00.766708 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e095bd02-bfbe-4bd8-b7b2-5197162f1543 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1371 microversion: 2.1 time: 0.288850 Sep 01 15:01:00.768186 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 145/299] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:00 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:00.780105 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:00.781685 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:00.799720 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:00.800392 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:00.801423 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:00.802304 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:00.802951 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:00.803521 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:00.930028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-3d51ad7f-82bd-438b-9ac7-6ffb031ff84c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:00.945864 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-3d51ad7f-82bd-438b-9ac7-6ffb031ff84c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1317 microversion: 2.1 time: 0.338226 Sep 01 15:01:00.947726 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 155/300] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:00 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:00.957001 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ec88bf9d-1ef5-4726-b3d9-8a0c47b3fbc5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:00.960480 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ec88bf9d-1ef5-4726-b3d9-8a0c47b3fbc5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:00.976878 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec88bf9d-1ef5-4726-b3d9-8a0c47b3fbc5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:00.979046 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec88bf9d-1ef5-4726-b3d9-8a0c47b3fbc5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:00.980364 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec88bf9d-1ef5-4726-b3d9-8a0c47b3fbc5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:00.981993 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec88bf9d-1ef5-4726-b3d9-8a0c47b3fbc5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:00.982738 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec88bf9d-1ef5-4726-b3d9-8a0c47b3fbc5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:00.983406 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec88bf9d-1ef5-4726-b3d9-8a0c47b3fbc5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:01.100752 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:01.118923 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:01.126038 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:01.128333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ef054e2d-b17a-4e3b-8706-e48c81521502 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1739 microversion: 2.20 time: 0.358375 Sep 01 15:01:01.150163 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 146/301] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:00 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1739 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:01.157594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-dbc4a5a9-620b-4b01-8c81-a7f6a4fda164 req-ca66b4ab-6c6f-4e82-85a6-77dc97ae5b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce44cdb3-951f-466c-bf47-efbaaa59257e", "tag": "a05e07ae-628f-4d01-bd85-f82e3792d6eb"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:01.172968 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-dbc4a5a9-620b-4b01-8c81-a7f6a4fda164 req-ca66b4ab-6c6f-4e82-85a6-77dc97ae5b40 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:01.173498 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-dbc4a5a9-620b-4b01-8c81-a7f6a4fda164 req-ca66b4ab-6c6f-4e82-85a6-77dc97ae5b40 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:01.174493 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-dbc4a5a9-620b-4b01-8c81-a7f6a4fda164 req-ca66b4ab-6c6f-4e82-85a6-77dc97ae5b40 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:01.192113 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-dbc4a5a9-620b-4b01-8c81-a7f6a4fda164 req-ca66b4ab-6c6f-4e82-85a6-77dc97ae5b40 service nova] Creating event network-changed:a05e07ae-628f-4d01-bd85-f82e3792d6eb for instance ce44cdb3-951f-466c-bf47-efbaaa59257e on hv-cinder-85505 Sep 01 15:01:01.198083 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-dbc4a5a9-620b-4b01-8c81-a7f6a4fda164 req-ca66b4ab-6c6f-4e82-85a6-77dc97ae5b40 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045995 Sep 01 15:01:01.199248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 147/302] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:01.222100 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ec88bf9d-1ef5-4726-b3d9-8a0c47b3fbc5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:01.230135 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ec88bf9d-1ef5-4726-b3d9-8a0c47b3fbc5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1314 microversion: 2.1 time: 0.279695 Sep 01 15:01:01.245501 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 156/303] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:00 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:01.619320 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-be88fb91-09c1-4549-957d-1a20cf4f21c0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:01.621169 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-be88fb91-09c1-4549-957d-1a20cf4f21c0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:01.635612 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-be88fb91-09c1-4549-957d-1a20cf4f21c0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:01.636942 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-be88fb91-09c1-4549-957d-1a20cf4f21c0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:01.639027 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-be88fb91-09c1-4549-957d-1a20cf4f21c0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:01.639929 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-be88fb91-09c1-4549-957d-1a20cf4f21c0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:01.642891 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-be88fb91-09c1-4549-957d-1a20cf4f21c0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:01.643426 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-be88fb91-09c1-4549-957d-1a20cf4f21c0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:01.793128 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a920984f-2314-4662-94ea-c9b234f6a61e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:01.794850 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a920984f-2314-4662-94ea-c9b234f6a61e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:01.807479 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a920984f-2314-4662-94ea-c9b234f6a61e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:01.808221 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a920984f-2314-4662-94ea-c9b234f6a61e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:01.808839 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a920984f-2314-4662-94ea-c9b234f6a61e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:01.814078 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a920984f-2314-4662-94ea-c9b234f6a61e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:01.814800 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a920984f-2314-4662-94ea-c9b234f6a61e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:01.816057 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a920984f-2314-4662-94ea-c9b234f6a61e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:01.883309 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-be88fb91-09c1-4549-957d-1a20cf4f21c0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:01.897427 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-be88fb91-09c1-4549-957d-1a20cf4f21c0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.281810 Sep 01 15:01:01.910270 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 148/304] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:01 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:01.969908 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-366056ee-db58-4f6a-8e8b-ccea9f3f5c8f tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:01.971146 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-366056ee-db58-4f6a-8e8b-ccea9f3f5c8f tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:01.979268 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-366056ee-db58-4f6a-8e8b-ccea9f3f5c8f tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:01.980513 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-366056ee-db58-4f6a-8e8b-ccea9f3f5c8f tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:01.980970 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-366056ee-db58-4f6a-8e8b-ccea9f3f5c8f tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:01.981889 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-366056ee-db58-4f6a-8e8b-ccea9f3f5c8f tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:01.982384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-366056ee-db58-4f6a-8e8b-ccea9f3f5c8f tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:01.982993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-366056ee-db58-4f6a-8e8b-ccea9f3f5c8f tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:02.028195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a920984f-2314-4662-94ea-c9b234f6a61e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:02.038810 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a920984f-2314-4662-94ea-c9b234f6a61e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1371 microversion: 2.1 time: 0.253897 Sep 01 15:01:02.040553 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 157/305] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:01 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:02.164150 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:02.164769 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:02.172823 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:02.173320 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:02.173756 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:02.174506 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:02.179214 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:02.179666 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:02.350480 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-366056ee-db58-4f6a-8e8b-ccea9f3f5c8f tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:02.358892 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-366056ee-db58-4f6a-8e8b-ccea9f3f5c8f tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1317 microversion: 2.1 time: 0.394584 Sep 01 15:01:02.359467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 149/306] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:01 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:02.374175 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-03ed1c3c-83ba-468b-95db-ca73084e4c0c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:02.375580 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-03ed1c3c-83ba-468b-95db-ca73084e4c0c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:02.383640 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03ed1c3c-83ba-468b-95db-ca73084e4c0c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:02.384536 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03ed1c3c-83ba-468b-95db-ca73084e4c0c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:02.385558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03ed1c3c-83ba-468b-95db-ca73084e4c0c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:02.386532 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03ed1c3c-83ba-468b-95db-ca73084e4c0c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:02.387206 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03ed1c3c-83ba-468b-95db-ca73084e4c0c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:02.387990 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03ed1c3c-83ba-468b-95db-ca73084e4c0c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:02.435565 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:02.449984 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:02.451846 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:02.453669 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c66e8cc8-dda2-4f5a-95d1-7fc8c635f74d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1739 microversion: 2.20 time: 0.303352 Sep 01 15:01:02.455512 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 158/307] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:02 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:02.471386 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-495aceae-8606-4686-a309-b7d01e3db81b req-f65d6bd8-1385-4be1-af99-d3312c699450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2570eed9-40bd-40ef-92d6-63b4e3cc83bf", "name": "network-vif-plugged", "status": "completed", "tag": "2edcc91b-b083-48b1-bb53-84caae283791"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:02.491916 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-495aceae-8606-4686-a309-b7d01e3db81b req-f65d6bd8-1385-4be1-af99-d3312c699450 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:02.492466 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-495aceae-8606-4686-a309-b7d01e3db81b req-f65d6bd8-1385-4be1-af99-d3312c699450 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:02.493618 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-495aceae-8606-4686-a309-b7d01e3db81b req-f65d6bd8-1385-4be1-af99-d3312c699450 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:02.507912 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-495aceae-8606-4686-a309-b7d01e3db81b req-f65d6bd8-1385-4be1-af99-d3312c699450 service nova] Creating event network-vif-plugged:2edcc91b-b083-48b1-bb53-84caae283791 for instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf on hv-cinder-85505 Sep 01 15:01:02.515204 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-495aceae-8606-4686-a309-b7d01e3db81b req-f65d6bd8-1385-4be1-af99-d3312c699450 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057824 Sep 01 15:01:02.516992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 159/308] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:02.553777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-03ed1c3c-83ba-468b-95db-ca73084e4c0c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:02.563025 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-03ed1c3c-83ba-468b-95db-ca73084e4c0c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1314 microversion: 2.1 time: 0.201571 Sep 01 15:01:02.568543 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 150/309] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:02 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:02.925188 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6cdb564d-f530-4126-aa8f-175a55081977 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:02.927078 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6cdb564d-f530-4126-aa8f-175a55081977 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:02.934533 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6cdb564d-f530-4126-aa8f-175a55081977 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:02.935269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6cdb564d-f530-4126-aa8f-175a55081977 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:02.935869 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6cdb564d-f530-4126-aa8f-175a55081977 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:02.936735 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6cdb564d-f530-4126-aa8f-175a55081977 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:02.938471 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6cdb564d-f530-4126-aa8f-175a55081977 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:02.939070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6cdb564d-f530-4126-aa8f-175a55081977 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:03.059727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a2640b4c-c48b-4864-be12-9142541a0208 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:03.061017 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a2640b4c-c48b-4864-be12-9142541a0208 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:03.063735 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:03.085645 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2640b4c-c48b-4864-be12-9142541a0208 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:03.090743 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2640b4c-c48b-4864-be12-9142541a0208 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:03.091212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2640b4c-c48b-4864-be12-9142541a0208 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:03.091956 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2640b4c-c48b-4864-be12-9142541a0208 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:03.092533 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2640b4c-c48b-4864-be12-9142541a0208 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:03.092961 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2640b4c-c48b-4864-be12-9142541a0208 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:03.236784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6cdb564d-f530-4126-aa8f-175a55081977 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:03.246004 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6cdb564d-f530-4126-aa8f-175a55081977 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.326335 Sep 01 15:01:03.247586 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 160/310] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:02 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:03.336815 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a2640b4c-c48b-4864-be12-9142541a0208 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:03.350837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a2640b4c-c48b-4864-be12-9142541a0208 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1371 microversion: 2.1 time: 0.295114 Sep 01 15:01:03.362297 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 151/311] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:03 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:03.385848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f11398a3-046b-42c6-99c8-5f36a6890dc0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:03.386419 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f11398a3-046b-42c6-99c8-5f36a6890dc0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:03.392256 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11398a3-046b-42c6-99c8-5f36a6890dc0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:03.393033 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11398a3-046b-42c6-99c8-5f36a6890dc0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:03.393851 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11398a3-046b-42c6-99c8-5f36a6890dc0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:03.395453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11398a3-046b-42c6-99c8-5f36a6890dc0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:03.396099 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11398a3-046b-42c6-99c8-5f36a6890dc0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:03.396844 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f11398a3-046b-42c6-99c8-5f36a6890dc0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:03.477711 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:03.487267 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:03.498090 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:03.498533 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:03.499010 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:03.499820 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:03.500287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:03.500774 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:03.631734 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f11398a3-046b-42c6-99c8-5f36a6890dc0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:03.643660 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f11398a3-046b-42c6-99c8-5f36a6890dc0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1317 microversion: 2.1 time: 0.262054 Sep 01 15:01:03.647084 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 161/312] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:03 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:03.674771 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-49e17c86-9e3a-4ea1-b6f5-018a0e616ea7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:03.675608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-49e17c86-9e3a-4ea1-b6f5-018a0e616ea7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:03.683826 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49e17c86-9e3a-4ea1-b6f5-018a0e616ea7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:03.684620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49e17c86-9e3a-4ea1-b6f5-018a0e616ea7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:03.685558 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49e17c86-9e3a-4ea1-b6f5-018a0e616ea7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:03.686459 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49e17c86-9e3a-4ea1-b6f5-018a0e616ea7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:03.687246 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49e17c86-9e3a-4ea1-b6f5-018a0e616ea7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:03.687974 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49e17c86-9e3a-4ea1-b6f5-018a0e616ea7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:03.710538 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:03.720259 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:03.723000 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:03.726138 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-43bad916-93f7-4eb7-8d7d-817ede983715 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1739 microversion: 2.20 time: 0.250861 Sep 01 15:01:03.727582 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 152/313] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:03 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:01:03.966886 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-49e17c86-9e3a-4ea1-b6f5-018a0e616ea7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:03.977647 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-49e17c86-9e3a-4ea1-b6f5-018a0e616ea7 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1314 microversion: 2.1 time: 0.324818 Sep 01 15:01:03.978511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 162/314] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:03 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:04.268216 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:04.274420 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-21ae7f98-7ac5-4f9f-8adf-4b657bef6085 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:04.275321 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-21ae7f98-7ac5-4f9f-8adf-4b657bef6085 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:04.283937 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-21ae7f98-7ac5-4f9f-8adf-4b657bef6085 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:04.284808 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-21ae7f98-7ac5-4f9f-8adf-4b657bef6085 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:04.285492 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-21ae7f98-7ac5-4f9f-8adf-4b657bef6085 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:04.286618 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-21ae7f98-7ac5-4f9f-8adf-4b657bef6085 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:04.290920 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-21ae7f98-7ac5-4f9f-8adf-4b657bef6085 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:04.291832 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-21ae7f98-7ac5-4f9f-8adf-4b657bef6085 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:04.376338 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a2fa9dfe-659d-4200-ab03-fd734a7177a3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:04.377379 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a2fa9dfe-659d-4200-ab03-fd734a7177a3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:04.384978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2fa9dfe-659d-4200-ab03-fd734a7177a3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:04.385505 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2fa9dfe-659d-4200-ab03-fd734a7177a3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:04.385948 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2fa9dfe-659d-4200-ab03-fd734a7177a3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:04.387481 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2fa9dfe-659d-4200-ab03-fd734a7177a3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:04.388162 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2fa9dfe-659d-4200-ab03-fd734a7177a3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:04.388599 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2fa9dfe-659d-4200-ab03-fd734a7177a3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:04.476708 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-21ae7f98-7ac5-4f9f-8adf-4b657bef6085 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:04.487508 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-21ae7f98-7ac5-4f9f-8adf-4b657bef6085 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.220256 Sep 01 15:01:04.488361 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 153/315] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:04 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:04.546051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a2fa9dfe-659d-4200-ab03-fd734a7177a3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:04.554921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a2fa9dfe-659d-4200-ab03-fd734a7177a3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1371 microversion: 2.1 time: 0.186035 Sep 01 15:01:04.556040 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 163/316] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:04 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:04.670387 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-aae57400-5c29-487e-b04f-fa8b264bd731 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:04.670921 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-aae57400-5c29-487e-b04f-fa8b264bd731 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:04.679870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aae57400-5c29-487e-b04f-fa8b264bd731 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:04.680644 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aae57400-5c29-487e-b04f-fa8b264bd731 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:04.681251 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aae57400-5c29-487e-b04f-fa8b264bd731 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:04.682142 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aae57400-5c29-487e-b04f-fa8b264bd731 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:04.682634 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aae57400-5c29-487e-b04f-fa8b264bd731 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:04.683067 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aae57400-5c29-487e-b04f-fa8b264bd731 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:04.757885 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:04.758833 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:04.767993 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:04.768814 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:04.769425 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:04.770429 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:04.772003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:04.772637 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:04.879433 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-aae57400-5c29-487e-b04f-fa8b264bd731 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:04.890071 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-aae57400-5c29-487e-b04f-fa8b264bd731 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1317 microversion: 2.1 time: 0.223955 Sep 01 15:01:04.894314 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 154/317] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:04 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:04.972276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:04.980185 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:04.981859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:04.983059 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-26ff39f0-8401-4a54-9836-42a872880076 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1739 microversion: 2.20 time: 0.229658 Sep 01 15:01:04.983598 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 164/318] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:04 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:05.000995 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-18f22311-3686-491d-9667-2092fbd5796f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:05.001913 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-18f22311-3686-491d-9667-2092fbd5796f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:05.009643 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18f22311-3686-491d-9667-2092fbd5796f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:05.010281 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18f22311-3686-491d-9667-2092fbd5796f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:05.010789 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18f22311-3686-491d-9667-2092fbd5796f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:05.011608 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18f22311-3686-491d-9667-2092fbd5796f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:05.012133 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18f22311-3686-491d-9667-2092fbd5796f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:05.012678 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-18f22311-3686-491d-9667-2092fbd5796f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:05.156934 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-18f22311-3686-491d-9667-2092fbd5796f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:05.165871 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-18f22311-3686-491d-9667-2092fbd5796f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1499 microversion: 2.1 time: 0.168758 Sep 01 15:01:05.166470 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 155/319] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:04 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1499 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:05.515187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b3b4d6b0-c3f1-4425-8927-9d8a7f8b9c30 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:05.515798 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b3b4d6b0-c3f1-4425-8927-9d8a7f8b9c30 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:05.523917 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3b4d6b0-c3f1-4425-8927-9d8a7f8b9c30 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:05.524676 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3b4d6b0-c3f1-4425-8927-9d8a7f8b9c30 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:05.525336 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3b4d6b0-c3f1-4425-8927-9d8a7f8b9c30 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:05.526327 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3b4d6b0-c3f1-4425-8927-9d8a7f8b9c30 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:05.527363 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3b4d6b0-c3f1-4425-8927-9d8a7f8b9c30 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:05.527999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3b4d6b0-c3f1-4425-8927-9d8a7f8b9c30 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:05.581087 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9a7b0fcf-a3a0-4133-8756-f599603ae4ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:05.581774 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9a7b0fcf-a3a0-4133-8756-f599603ae4ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:05.592346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a7b0fcf-a3a0-4133-8756-f599603ae4ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:05.593139 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a7b0fcf-a3a0-4133-8756-f599603ae4ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:05.593754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a7b0fcf-a3a0-4133-8756-f599603ae4ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:05.594912 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a7b0fcf-a3a0-4133-8756-f599603ae4ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:05.595858 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a7b0fcf-a3a0-4133-8756-f599603ae4ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:05.597454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a7b0fcf-a3a0-4133-8756-f599603ae4ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:05.721051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b3b4d6b0-c3f1-4425-8927-9d8a7f8b9c30 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:05.732155 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b3b4d6b0-c3f1-4425-8927-9d8a7f8b9c30 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.219451 Sep 01 15:01:05.736250 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 165/320] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:05 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:05.844022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9a7b0fcf-a3a0-4133-8756-f599603ae4ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:05.855080 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9a7b0fcf-a3a0-4133-8756-f599603ae4ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1371 microversion: 2.1 time: 0.278689 Sep 01 15:01:05.856040 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 156/321] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:05 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:05.895881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-edabc2ec-c23e-48cb-b4c1-1a3603f513ba tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:05.897301 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-edabc2ec-c23e-48cb-b4c1-1a3603f513ba tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:05.904046 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-edabc2ec-c23e-48cb-b4c1-1a3603f513ba tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:05.906990 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-edabc2ec-c23e-48cb-b4c1-1a3603f513ba tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:05.908050 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-edabc2ec-c23e-48cb-b4c1-1a3603f513ba tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:05.908848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-edabc2ec-c23e-48cb-b4c1-1a3603f513ba tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:05.909382 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-edabc2ec-c23e-48cb-b4c1-1a3603f513ba tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:05.909881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-edabc2ec-c23e-48cb-b4c1-1a3603f513ba tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:05.914214 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-859098ac-4912-4e64-aa48-2f00ebaf0241 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:05.915161 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-859098ac-4912-4e64-aa48-2f00ebaf0241 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:05.921226 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-859098ac-4912-4e64-aa48-2f00ebaf0241 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:05.921712 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-859098ac-4912-4e64-aa48-2f00ebaf0241 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:05.922148 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-859098ac-4912-4e64-aa48-2f00ebaf0241 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:05.922877 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-859098ac-4912-4e64-aa48-2f00ebaf0241 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:05.923360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-859098ac-4912-4e64-aa48-2f00ebaf0241 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:05.933996 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-859098ac-4912-4e64-aa48-2f00ebaf0241 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:05.941472 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=100 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:05.944243 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-edabc2ec-c23e-48cb-b4c1-1a3603f513ba tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Going to try to terminate instance {{(pid=120553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:01:06.054064 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-edabc2ec-c23e-48cb-b4c1-1a3603f513ba tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "DELETE /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 204 len: 0 microversion: 2.1 time: 0.165111 Sep 01 15:01:06.061049 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 166/322] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:01:05 2022] DELETE /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:01:06.068720 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:06.069768 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:06.076450 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:06.077242 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:06.077909 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:06.078874 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:06.079543 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:06.080180 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:06.120392 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-859098ac-4912-4e64-aa48-2f00ebaf0241 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:06.131148 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-859098ac-4912-4e64-aa48-2f00ebaf0241 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1317 microversion: 2.1 time: 0.220535 Sep 01 15:01:06.133233 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 157/323] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:05 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:06.145322 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-eecc695a-c508-472d-bf4e-64f00fc0027e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:06.146209 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-eecc695a-c508-472d-bf4e-64f00fc0027e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:06.156112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecc695a-c508-472d-bf4e-64f00fc0027e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:06.157231 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecc695a-c508-472d-bf4e-64f00fc0027e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:06.158007 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecc695a-c508-472d-bf4e-64f00fc0027e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:06.158993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecc695a-c508-472d-bf4e-64f00fc0027e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:06.159804 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecc695a-c508-472d-bf4e-64f00fc0027e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:06.160439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecc695a-c508-472d-bf4e-64f00fc0027e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:06.303702 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:06.317078 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:06.320759 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:06.322762 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-42a6aa6a-0d5e-47af-833f-4059b0b3826e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1739 microversion: 2.20 time: 0.258995 Sep 01 15:01:06.323330 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 167/324] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:06 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:06.334151 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-1d124823-3fa5-4d1e-bad2-c55c6ccdb53a req-6ad43ca6-e2c5-4043-8814-4c727555260f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da903e65-d948-457a-8d12-9253ffeacb02", "name": "network-vif-plugged", "status": "completed", "tag": "c6295804-bbdf-4e7a-af58-cedd94bf76a7"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:06.349273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-1d124823-3fa5-4d1e-bad2-c55c6ccdb53a req-6ad43ca6-e2c5-4043-8814-4c727555260f service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:06.350421 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-1d124823-3fa5-4d1e-bad2-c55c6ccdb53a req-6ad43ca6-e2c5-4043-8814-4c727555260f service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:06.351107 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-1d124823-3fa5-4d1e-bad2-c55c6ccdb53a req-6ad43ca6-e2c5-4043-8814-4c727555260f service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:06.370644 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-1d124823-3fa5-4d1e-bad2-c55c6ccdb53a req-6ad43ca6-e2c5-4043-8814-4c727555260f service nova] Creating event network-vif-plugged:c6295804-bbdf-4e7a-af58-cedd94bf76a7 for instance da903e65-d948-457a-8d12-9253ffeacb02 on hv-cinder-85505 Sep 01 15:01:06.375551 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-1d124823-3fa5-4d1e-bad2-c55c6ccdb53a req-6ad43ca6-e2c5-4043-8814-4c727555260f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046964 Sep 01 15:01:06.376158 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 168/325] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:06.390832 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-eecc695a-c508-472d-bf4e-64f00fc0027e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:06.399705 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-eecc695a-c508-472d-bf4e-64f00fc0027e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1505 microversion: 2.1 time: 0.264966 Sep 01 15:01:06.400706 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 158/326] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:06 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:06.757518 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cdbae4e6-347a-442c-99ff-f94bc2a0c056 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:06.758737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-cdbae4e6-347a-442c-99ff-f94bc2a0c056 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:06.765601 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cdbae4e6-347a-442c-99ff-f94bc2a0c056 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:06.766160 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cdbae4e6-347a-442c-99ff-f94bc2a0c056 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:06.766584 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cdbae4e6-347a-442c-99ff-f94bc2a0c056 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:06.767628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cdbae4e6-347a-442c-99ff-f94bc2a0c056 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:06.768329 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cdbae4e6-347a-442c-99ff-f94bc2a0c056 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:06.769011 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cdbae4e6-347a-442c-99ff-f94bc2a0c056 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:06.848507 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:06.869759 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=12 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:06.883747 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9e698335-9109-43cd-a7c7-c1c535fa9950 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:06.884453 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9e698335-9109-43cd-a7c7-c1c535fa9950 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:06.897797 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e698335-9109-43cd-a7c7-c1c535fa9950 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:06.899188 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e698335-9109-43cd-a7c7-c1c535fa9950 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:06.917272 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e698335-9109-43cd-a7c7-c1c535fa9950 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:06.929294 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e698335-9109-43cd-a7c7-c1c535fa9950 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:06.934087 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e698335-9109-43cd-a7c7-c1c535fa9950 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:06.935789 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e698335-9109-43cd-a7c7-c1c535fa9950 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:07.034936 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=8 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:07.079254 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-cdbae4e6-347a-442c-99ff-f94bc2a0c056 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:07.103439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cdbae4e6-347a-442c-99ff-f94bc2a0c056 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.350008 Sep 01 15:01:07.123823 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 169/327] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:06 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:07.160027 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e0530198-bb5a-4a77-955f-f6200ae0b66a tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:07.162863 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e0530198-bb5a-4a77-955f-f6200ae0b66a tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:07.177224 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0530198-bb5a-4a77-955f-f6200ae0b66a tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:07.178017 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0530198-bb5a-4a77-955f-f6200ae0b66a tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:07.180852 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0530198-bb5a-4a77-955f-f6200ae0b66a tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:07.181904 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0530198-bb5a-4a77-955f-f6200ae0b66a tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:07.182554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0530198-bb5a-4a77-955f-f6200ae0b66a tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:07.184788 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0530198-bb5a-4a77-955f-f6200ae0b66a tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:07.212891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:07.239097 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9e698335-9109-43cd-a7c7-c1c535fa9950 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:07.250165 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9e698335-9109-43cd-a7c7-c1c535fa9950 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1371 microversion: 2.1 time: 0.371185 Sep 01 15:01:07.262666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 159/328] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:06 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:07.347516 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:07.348134 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:07.374745 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:07.375912 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:07.376491 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:07.377191 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:07.377646 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:07.378070 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:07.439879 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e0530198-bb5a-4a77-955f-f6200ae0b66a tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:07.450424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e0530198-bb5a-4a77-955f-f6200ae0b66a tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1317 microversion: 2.1 time: 0.296486 Sep 01 15:01:07.452260 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 170/329] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:07 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:07.476942 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5e8db80c-6c1b-4398-9642-8002bd8b0f2e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:07.483893 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5e8db80c-6c1b-4398-9642-8002bd8b0f2e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:07.509200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e8db80c-6c1b-4398-9642-8002bd8b0f2e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:07.514534 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e8db80c-6c1b-4398-9642-8002bd8b0f2e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:07.515200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e8db80c-6c1b-4398-9642-8002bd8b0f2e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:07.516090 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e8db80c-6c1b-4398-9642-8002bd8b0f2e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:07.516704 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e8db80c-6c1b-4398-9642-8002bd8b0f2e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:07.517290 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5e8db80c-6c1b-4398-9642-8002bd8b0f2e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:07.600295 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:07.610267 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:07.614211 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:07.614211 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-96292d78-f7f2-4cf0-82ac-cd4e84a524ce tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1739 microversion: 2.20 time: 0.270091 Sep 01 15:01:07.614211 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 160/330] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:07 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:01:07.876667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-5e8db80c-6c1b-4398-9642-8002bd8b0f2e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:07.884704 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5e8db80c-6c1b-4398-9642-8002bd8b0f2e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1505 microversion: 2.1 time: 0.431280 Sep 01 15:01:07.898999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 171/331] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:07 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:08.129993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-94082f8c-dd28-42c4-b279-cc08021d7e01 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:08.130753 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-94082f8c-dd28-42c4-b279-cc08021d7e01 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:08.139583 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94082f8c-dd28-42c4-b279-cc08021d7e01 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:08.140349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94082f8c-dd28-42c4-b279-cc08021d7e01 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:08.142497 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94082f8c-dd28-42c4-b279-cc08021d7e01 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:08.143449 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94082f8c-dd28-42c4-b279-cc08021d7e01 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:08.145658 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94082f8c-dd28-42c4-b279-cc08021d7e01 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:08.149937 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-94082f8c-dd28-42c4-b279-cc08021d7e01 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:08.276009 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-eb6ce0e1-cb44-4e15-941d-a6781e7151ba tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:08.277516 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-eb6ce0e1-cb44-4e15-941d-a6781e7151ba tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:08.286166 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb6ce0e1-cb44-4e15-941d-a6781e7151ba tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:08.286698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb6ce0e1-cb44-4e15-941d-a6781e7151ba tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:08.290272 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb6ce0e1-cb44-4e15-941d-a6781e7151ba tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:08.291260 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb6ce0e1-cb44-4e15-941d-a6781e7151ba tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:08.291920 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb6ce0e1-cb44-4e15-941d-a6781e7151ba tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:08.292532 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb6ce0e1-cb44-4e15-941d-a6781e7151ba tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:08.441132 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-94082f8c-dd28-42c4-b279-cc08021d7e01 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:08.457803 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-94082f8c-dd28-42c4-b279-cc08021d7e01 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.332519 Sep 01 15:01:08.459642 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 161/332] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:08 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:08.480239 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2b961e24-0b49-4cd2-8299-60c938ad763b tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:08.481276 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2b961e24-0b49-4cd2-8299-60c938ad763b tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:08.500153 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b961e24-0b49-4cd2-8299-60c938ad763b tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:08.502383 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b961e24-0b49-4cd2-8299-60c938ad763b tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:08.505288 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b961e24-0b49-4cd2-8299-60c938ad763b tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:08.507420 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b961e24-0b49-4cd2-8299-60c938ad763b tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:08.508455 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b961e24-0b49-4cd2-8299-60c938ad763b tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:08.509856 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b961e24-0b49-4cd2-8299-60c938ad763b tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:08.578311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-eb6ce0e1-cb44-4e15-941d-a6781e7151ba tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:08.588418 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-eb6ce0e1-cb44-4e15-941d-a6781e7151ba tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1371 microversion: 2.1 time: 0.319367 Sep 01 15:01:08.595518 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 172/333] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:08 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1371 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:08.619994 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-b4064af3-00d9-4ef8-8b29-af44df9acc93 req-f02dd379-6ea4-48ab-9c66-d852edc16a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00b27769-efab-4939-913d-cb3119257046", "name": "network-vif-deleted", "tag": "51c60c03-13c0-4a16-91e7-7348d177b947"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:08.634837 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-b4064af3-00d9-4ef8-8b29-af44df9acc93 req-f02dd379-6ea4-48ab-9c66-d852edc16a77 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:08.635658 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-b4064af3-00d9-4ef8-8b29-af44df9acc93 req-f02dd379-6ea4-48ab-9c66-d852edc16a77 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:08.636751 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-b4064af3-00d9-4ef8-8b29-af44df9acc93 req-f02dd379-6ea4-48ab-9c66-d852edc16a77 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:08.652673 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-b4064af3-00d9-4ef8-8b29-af44df9acc93 req-f02dd379-6ea4-48ab-9c66-d852edc16a77 service nova] Creating event network-vif-deleted:51c60c03-13c0-4a16-91e7-7348d177b947 for instance 00b27769-efab-4939-913d-cb3119257046 on hv-cinder-85505 Sep 01 15:01:08.659188 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-b4064af3-00d9-4ef8-8b29-af44df9acc93 req-f02dd379-6ea4-48ab-9c66-d852edc16a77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060193 Sep 01 15:01:08.661224 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 173/334] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:08.677053 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:08.678862 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:08.694978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:08.695609 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:08.696019 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:08.696915 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:08.697628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:08.698269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:08.769982 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2b961e24-0b49-4cd2-8299-60c938ad763b tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:08.783613 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2b961e24-0b49-4cd2-8299-60c938ad763b tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1317 microversion: 2.1 time: 0.310284 Sep 01 15:01:08.799306 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 162/335] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:08 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:08.923349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7ceaf61d-705e-49be-b5e1-6346dfa1a4d6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:08.925263 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7ceaf61d-705e-49be-b5e1-6346dfa1a4d6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:08.940626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ceaf61d-705e-49be-b5e1-6346dfa1a4d6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:08.941274 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ceaf61d-705e-49be-b5e1-6346dfa1a4d6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:08.942908 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ceaf61d-705e-49be-b5e1-6346dfa1a4d6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:08.943863 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ceaf61d-705e-49be-b5e1-6346dfa1a4d6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:08.946326 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ceaf61d-705e-49be-b5e1-6346dfa1a4d6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:08.947002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ceaf61d-705e-49be-b5e1-6346dfa1a4d6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:08.948115 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:08.957414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:08.959980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:08.962505 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b936b72b-c9bb-4285-a9a4-07141d6ad946 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1739 microversion: 2.20 time: 0.294781 Sep 01 15:01:08.963232 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 174/336] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:08 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:09.143718 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7ceaf61d-705e-49be-b5e1-6346dfa1a4d6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:09.158369 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7ceaf61d-705e-49be-b5e1-6346dfa1a4d6 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1299 microversion: 2.1 time: 0.242816 Sep 01 15:01:09.159856 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 163/337] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:08 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1299 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:09.481563 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7f66a80a-7bd1-4207-9108-c13f1ebecfd1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:09.482176 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7f66a80a-7bd1-4207-9108-c13f1ebecfd1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:09.489423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f66a80a-7bd1-4207-9108-c13f1ebecfd1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:09.490801 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f66a80a-7bd1-4207-9108-c13f1ebecfd1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:09.491263 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f66a80a-7bd1-4207-9108-c13f1ebecfd1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:09.492180 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f66a80a-7bd1-4207-9108-c13f1ebecfd1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:09.492650 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f66a80a-7bd1-4207-9108-c13f1ebecfd1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:09.493085 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f66a80a-7bd1-4207-9108-c13f1ebecfd1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:09.614539 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6331646e-495a-4ed4-aca6-8c97ae6eb7e3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:09.615867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6331646e-495a-4ed4-aca6-8c97ae6eb7e3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:09.626196 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6331646e-495a-4ed4-aca6-8c97ae6eb7e3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:09.627991 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6331646e-495a-4ed4-aca6-8c97ae6eb7e3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:09.630162 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6331646e-495a-4ed4-aca6-8c97ae6eb7e3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:09.645691 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6331646e-495a-4ed4-aca6-8c97ae6eb7e3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:09.646199 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6331646e-495a-4ed4-aca6-8c97ae6eb7e3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:09.647213 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6331646e-495a-4ed4-aca6-8c97ae6eb7e3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:09.668640 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-7f66a80a-7bd1-4207-9108-c13f1ebecfd1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:09.683065 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7f66a80a-7bd1-4207-9108-c13f1ebecfd1 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1725 microversion: 2.1 time: 0.204865 Sep 01 15:01:09.684419 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 175/338] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:09 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:09.820696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-3fc0863a-ab5f-4abe-b1d7-0b4160685b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:09.821773 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-3fc0863a-ab5f-4abe-b1d7-0b4160685b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:09.852863 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3fc0863a-ab5f-4abe-b1d7-0b4160685b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:09.855734 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3fc0863a-ab5f-4abe-b1d7-0b4160685b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:09.856580 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3fc0863a-ab5f-4abe-b1d7-0b4160685b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:09.859779 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3fc0863a-ab5f-4abe-b1d7-0b4160685b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:09.862208 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3fc0863a-ab5f-4abe-b1d7-0b4160685b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:09.863175 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3fc0863a-ab5f-4abe-b1d7-0b4160685b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:09.948494 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6331646e-495a-4ed4-aca6-8c97ae6eb7e3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:09.966599 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6331646e-495a-4ed4-aca6-8c97ae6eb7e3 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1371 microversion: 2.1 time: 0.355591 Sep 01 15:01:09.967199 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 164/339] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:09 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:09.992234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:09.999444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:10.028058 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:10.028567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:10.029096 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:10.029930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:10.030431 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:10.033819 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:10.236317 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:10.238019 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-3fc0863a-ab5f-4abe-b1d7-0b4160685b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:10.247247 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:10.248893 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-3fc0863a-ab5f-4abe-b1d7-0b4160685b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1317 microversion: 2.1 time: 0.431002 Sep 01 15:01:10.249936 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:10.251409 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ead705c4-eb69-4bff-b565-d31535f48197 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1739 microversion: 2.20 time: 0.263205 Sep 01 15:01:10.267453 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 165/340] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:09 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:10.270337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 176/341] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:09 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:10.280678 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:10.281417 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:10.300348 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:10.301787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:10.303964 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:10.304883 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:10.305824 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:10.311319 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:10.398380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:10.399177 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:10.399882 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:10.400668 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.objects.instance [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lazy-loading 'fault' on Instance uuid 00b27769-efab-4939-913d-cb3119257046 {{(pid=120554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:01:10.467780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:10.477852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6e0655aa-3c71-448b-a7ed-a4fb684357e4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 200 len: 1304 microversion: 2.1 time: 0.208360 Sep 01 15:01:10.478716 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 166/342] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:10 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 1304 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:10.496170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-0dd4ab6c-8b08-4979-ac91-9df75769afae req-118d40e7-d099-47cf-b4db-7563f17d08b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce44cdb3-951f-466c-bf47-efbaaa59257e", "name": "network-vif-plugged", "status": "completed", "tag": "a05e07ae-628f-4d01-bd85-f82e3792d6eb"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:10.508221 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-0dd4ab6c-8b08-4979-ac91-9df75769afae req-118d40e7-d099-47cf-b4db-7563f17d08b1 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:10.509182 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-0dd4ab6c-8b08-4979-ac91-9df75769afae req-118d40e7-d099-47cf-b4db-7563f17d08b1 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:10.509830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-0dd4ab6c-8b08-4979-ac91-9df75769afae req-118d40e7-d099-47cf-b4db-7563f17d08b1 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:10.522598 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-0dd4ab6c-8b08-4979-ac91-9df75769afae req-118d40e7-d099-47cf-b4db-7563f17d08b1 service nova] Creating event network-vif-plugged:a05e07ae-628f-4d01-bd85-f82e3792d6eb for instance ce44cdb3-951f-466c-bf47-efbaaa59257e on hv-cinder-85505 Sep 01 15:01:10.528496 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-0dd4ab6c-8b08-4979-ac91-9df75769afae req-118d40e7-d099-47cf-b4db-7563f17d08b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036652 Sep 01 15:01:10.529617 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 177/343] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:10.705575 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-33636299-335b-4b5d-9c3a-d94a53873cee tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:10.706495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-33636299-335b-4b5d-9c3a-d94a53873cee tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:10.721032 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-33636299-335b-4b5d-9c3a-d94a53873cee tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:10.723854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-33636299-335b-4b5d-9c3a-d94a53873cee tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:10.724908 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-33636299-335b-4b5d-9c3a-d94a53873cee tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:10.725921 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-33636299-335b-4b5d-9c3a-d94a53873cee tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:10.731696 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-33636299-335b-4b5d-9c3a-d94a53873cee tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:10.732463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-33636299-335b-4b5d-9c3a-d94a53873cee tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:10.953707 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-33636299-335b-4b5d-9c3a-d94a53873cee tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:10.964143 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-33636299-335b-4b5d-9c3a-d94a53873cee tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1702 microversion: 2.1 time: 0.263791 Sep 01 15:01:10.978982 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 167/344] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:10 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1702 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:10.987372 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cbec81f9-a3f7-4bd9-beb1-61f1070d9c14 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:10.992147 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-91312f3a-e6d8-48a3-8e47-1ca85b878fc7 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:10.992964 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-91312f3a-e6d8-48a3-8e47-1ca85b878fc7 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:10.995337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cbec81f9-a3f7-4bd9-beb1-61f1070d9c14 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:10.995988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cbec81f9-a3f7-4bd9-beb1-61f1070d9c14 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:10.996594 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cbec81f9-a3f7-4bd9-beb1-61f1070d9c14 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.000351 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91312f3a-e6d8-48a3-8e47-1ca85b878fc7 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.001215 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91312f3a-e6d8-48a3-8e47-1ca85b878fc7 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.001963 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91312f3a-e6d8-48a3-8e47-1ca85b878fc7 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.003057 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91312f3a-e6d8-48a3-8e47-1ca85b878fc7 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.006453 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91312f3a-e6d8-48a3-8e47-1ca85b878fc7 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.007155 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91312f3a-e6d8-48a3-8e47-1ca85b878fc7 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.078438 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-cbec81f9-a3f7-4bd9-beb1-61f1070d9c14 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Going to try to start instance {{(pid=120553) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 15:01:11.155704 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cbec81f9-a3f7-4bd9-beb1-61f1070d9c14 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "POST /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/action" status: 202 len: 0 microversion: 2.1 time: 0.172588 Sep 01 15:01:11.156352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 178/345] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:01:10 2022] POST /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:01:11.168314 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1472ba63-a882-4bac-844e-7765da7a3a7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:11.169137 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1472ba63-a882-4bac-844e-7765da7a3a7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:11.175615 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-91312f3a-e6d8-48a3-8e47-1ca85b878fc7 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:11.177002 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1472ba63-a882-4bac-844e-7765da7a3a7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.177810 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1472ba63-a882-4bac-844e-7765da7a3a7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.178364 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1472ba63-a882-4bac-844e-7765da7a3a7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.179065 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1472ba63-a882-4bac-844e-7765da7a3a7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.179523 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1472ba63-a882-4bac-844e-7765da7a3a7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.179946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1472ba63-a882-4bac-844e-7765da7a3a7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.190620 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-91312f3a-e6d8-48a3-8e47-1ca85b878fc7 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1565 microversion: 2.1 time: 0.205487 Sep 01 15:01:11.203635 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 168/346] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:10 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1565 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:11.229124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e61bd358-76da-4267-91cc-732ddc43bdc8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:11.230097 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e61bd358-76da-4267-91cc-732ddc43bdc8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:11.240130 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e61bd358-76da-4267-91cc-732ddc43bdc8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.246754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e61bd358-76da-4267-91cc-732ddc43bdc8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.247432 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e61bd358-76da-4267-91cc-732ddc43bdc8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.248494 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e61bd358-76da-4267-91cc-732ddc43bdc8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.249248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e61bd358-76da-4267-91cc-732ddc43bdc8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.249920 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e61bd358-76da-4267-91cc-732ddc43bdc8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.427713 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e61bd358-76da-4267-91cc-732ddc43bdc8 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.218577 Sep 01 15:01:11.429521 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 169/347] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 1 15:01:11 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:11.436877 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1472ba63-a882-4bac-844e-7765da7a3a7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:11.439403 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9e084b84-28bc-4a5b-8ab7-64ac2a40edac tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:11.440389 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9e084b84-28bc-4a5b-8ab7-64ac2a40edac tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:11.447596 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e084b84-28bc-4a5b-8ab7-64ac2a40edac tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.448370 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e084b84-28bc-4a5b-8ab7-64ac2a40edac tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.448961 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e084b84-28bc-4a5b-8ab7-64ac2a40edac tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.451117 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e084b84-28bc-4a5b-8ab7-64ac2a40edac tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.451774 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e084b84-28bc-4a5b-8ab7-64ac2a40edac tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.452368 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9e084b84-28bc-4a5b-8ab7-64ac2a40edac tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.469954 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1472ba63-a882-4bac-844e-7765da7a3a7b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1711 microversion: 2.1 time: 0.309099 Sep 01 15:01:11.471233 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 179/348] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:11 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1711 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:11.476954 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:11.477711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:11.484687 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.485329 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.485863 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.486718 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.487292 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.487815 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.678915 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:11.697936 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:11.699604 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:11.701140 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e58d2875-fd95-45d0-b2ba-3a78e80a22c9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1739 microversion: 2.20 time: 0.228705 Sep 01 15:01:11.701848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 180/349] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:11 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:11.707147 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:11.707981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 00b27769-efab-4939-913d-cb3119257046] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:11.715024 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.715720 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.716323 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.717176 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:11.717802 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:11.718460 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:11.738312 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] HTTP exception thrown: Instance 00b27769-efab-4939-913d-cb3119257046 could not be found. Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Request method failure captured: Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 HTTP/1.1 Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMkUObmL21RWLOWS0elDaQzD6eSlDU5mACnELJWG0Y8bicDbZ4VqP1chCO8FoGkYICRi1RRKWYgKMb5aDOaTftleN4Hj70D7pP33g5V2FDplzh7VsdZJOjXzCUsm2xDdPmDwWiDxoaGpGycOuJrCWDSHtv2HIFHwYcvUHTN2vERHf94 Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: ba5a5ea6aa4b4736ae49915583626e18 Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-VolumesActionsTest-1134162667 Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:01:11.741167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba5a5ea6aa4b4736ae49915583626e18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba5a5ea6aa4b4736ae49915583626e18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba5a5ea6aa4b4736ae49915583626e18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba5a5ea6aa4b4736ae49915583626e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-VolumesActionsTest-1134162667 Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: ba5a5ea6aa4b4736ae49915583626e18 Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-VolumesActionsTest-1134162667 Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-VolumesActionsTest-1134162667-project Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 534901c491b64bbe8bdc59776e643a78 Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-VolumesActionsTest-1134162667-project Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 00b27769-efab-4939-913d-cb3119257046 could not be found. Sep 01 15:01:11.743192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '00b27769-efab-4939-913d-cb3119257046'} Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00b27769-efab-4939-913d-cb3119257046 could not be found. Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:01:11.744276 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00b27769-efab-4939-913d-cb3119257046 could not be found. Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00b27769-efab-4939-913d-cb3119257046 could not be found. Sep 01 15:01:11.745811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:01:11.748787 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Returning 404 to user: Instance 00b27769-efab-4939-913d-cb3119257046 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:01:11.749808 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-00b21622-7b6d-418c-ab24-dea2364b7219 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046" status: 404 len: 111 microversion: 2.1 time: 0.046608 Sep 01 15:01:11.751347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 181/350] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:11 2022] GET /compute/v2.1/servers/00b27769-efab-4939-913d-cb3119257046 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:01:11.877902 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-831285478", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "networks": [{"uuid": "8585d291-02d8-4ee1-8d61-d320904eefd6"}]}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:11.984570 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.network.neutron [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] validate_networks() for [('8585d291-02d8-4ee1-8d61-d320904eefd6', None, None, None, None, None)] {{(pid=120553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:01:12.020047 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9e084b84-28bc-4a5b-8ab7-64ac2a40edac tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:12.028100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9e084b84-28bc-4a5b-8ab7-64ac2a40edac tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1317 microversion: 2.1 time: 0.596357 Sep 01 15:01:12.029026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 170/351] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:11 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:12.539366 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9877f5d2-7840-496a-b193-014f8bd49f77 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:12.540862 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9877f5d2-7840-496a-b193-014f8bd49f77 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:12.557237 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9877f5d2-7840-496a-b193-014f8bd49f77 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:12.558035 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9877f5d2-7840-496a-b193-014f8bd49f77 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:12.558568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9877f5d2-7840-496a-b193-014f8bd49f77 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:12.559511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9877f5d2-7840-496a-b193-014f8bd49f77 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:12.562647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9877f5d2-7840-496a-b193-014f8bd49f77 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:12.563321 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9877f5d2-7840-496a-b193-014f8bd49f77 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:12.934508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Flavor limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:01:12.934956 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Image limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:01:12.935381 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Flavor pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:01:12.935872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Image pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:01:12.936169 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:01:12.949703 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:12.950198 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:12.953667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:12.954481 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:12.954955 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:12.955387 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:13.001034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Getting quotas for project ba5a5ea6aa4b4736ae49915583626e18. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:01:13.016926 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Getting quotas for user 534901c491b64bbe8bdc59776e643a78 and project ba5a5ea6aa4b4736ae49915583626e18. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:01:13.037269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Going to run 1 instances... {{(pid=120553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:01:13.039636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:01:13.058870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9877f5d2-7840-496a-b193-014f8bd49f77 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:13.069242 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9877f5d2-7840-496a-b193-014f8bd49f77 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1711 microversion: 2.1 time: 0.535511 Sep 01 15:01:13.078496 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 171/352] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:12 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1711 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:13.101987 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:13.102800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:13.112166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:13.114392 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:13.114979 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:13.116119 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:13.122838 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:13.123371 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:13.128555 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9290ab3c-ebae-4170-af33-773810b4391e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.256694 Sep 01 15:01:13.129777 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 182/353] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:01:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:01:13.136696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e647b1f3-e6c1-4c71-b895-dde69a284a0e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:13.137640 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e647b1f3-e6c1-4c71-b895-dde69a284a0e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:13.144389 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e647b1f3-e6c1-4c71-b895-dde69a284a0e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:13.145094 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e647b1f3-e6c1-4c71-b895-dde69a284a0e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:13.145697 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e647b1f3-e6c1-4c71-b895-dde69a284a0e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:13.147157 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e647b1f3-e6c1-4c71-b895-dde69a284a0e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:13.147769 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e647b1f3-e6c1-4c71-b895-dde69a284a0e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:13.148350 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e647b1f3-e6c1-4c71-b895-dde69a284a0e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:13.357776 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e647b1f3-e6c1-4c71-b895-dde69a284a0e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:13.369087 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e647b1f3-e6c1-4c71-b895-dde69a284a0e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1507 microversion: 2.1 time: 0.237248 Sep 01 15:01:13.370178 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 183/354] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:13 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:13.375073 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2b11f717-cceb-47bf-8d5f-e26b924877e0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:13.376408 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2b11f717-cceb-47bf-8d5f-e26b924877e0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:13.518283 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:13.549716 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2b11f717-cceb-47bf-8d5f-e26b924877e0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:13.560466 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2b11f717-cceb-47bf-8d5f-e26b924877e0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1213 microversion: 2.1 time: 0.188780 Sep 01 15:01:13.561587 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:13.569462 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:13.572123 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 184/355] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:13 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1213 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:13.578970 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b78b0924-e53b-4033-bf7a-7dd29cb9e554 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1739 microversion: 2.20 time: 0.497916 Sep 01 15:01:13.582628 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 172/356] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:13 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1739 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:13.590481 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-141a5261-0aee-4780-acfe-43cb31b72b49 req-a401118e-1aca-436e-b15d-c1b74645a7df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da903e65-d948-457a-8d12-9253ffeacb02", "tag": "c6295804-bbdf-4e7a-af58-cedd94bf76a7"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:13.603511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-141a5261-0aee-4780-acfe-43cb31b72b49 req-a401118e-1aca-436e-b15d-c1b74645a7df service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:13.605500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-141a5261-0aee-4780-acfe-43cb31b72b49 req-a401118e-1aca-436e-b15d-c1b74645a7df service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:13.606151 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-141a5261-0aee-4780-acfe-43cb31b72b49 req-a401118e-1aca-436e-b15d-c1b74645a7df service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:13.625341 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-141a5261-0aee-4780-acfe-43cb31b72b49 req-a401118e-1aca-436e-b15d-c1b74645a7df service nova] Creating event network-changed:c6295804-bbdf-4e7a-af58-cedd94bf76a7 for instance da903e65-d948-457a-8d12-9253ffeacb02 on hv-cinder-85505 Sep 01 15:01:13.639200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-141a5261-0aee-4780-acfe-43cb31b72b49 req-a401118e-1aca-436e-b15d-c1b74645a7df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065077 Sep 01 15:01:13.643581 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 185/357] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:14.099871 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-bfde93cf-0089-40c3-be77-372d18ea6c4a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:14.100854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-bfde93cf-0089-40c3-be77-372d18ea6c4a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:14.136516 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bfde93cf-0089-40c3-be77-372d18ea6c4a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:14.140046 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bfde93cf-0089-40c3-be77-372d18ea6c4a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:14.142212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bfde93cf-0089-40c3-be77-372d18ea6c4a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:14.143751 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bfde93cf-0089-40c3-be77-372d18ea6c4a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:14.147759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bfde93cf-0089-40c3-be77-372d18ea6c4a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:14.150124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bfde93cf-0089-40c3-be77-372d18ea6c4a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:14.489642 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-bfde93cf-0089-40c3-be77-372d18ea6c4a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:14.495159 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=100 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:14.501485 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-bfde93cf-0089-40c3-be77-372d18ea6c4a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1711 microversion: 2.1 time: 0.406369 Sep 01 15:01:14.502047 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 173/358] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:14 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1711 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:14.595903 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a2ed9394-2521-4f27-bfb7-89dbeac28960 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:14.596636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a2ed9394-2521-4f27-bfb7-89dbeac28960 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:14.605327 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2ed9394-2521-4f27-bfb7-89dbeac28960 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:14.605681 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:14.606132 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2ed9394-2521-4f27-bfb7-89dbeac28960 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:14.606643 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2ed9394-2521-4f27-bfb7-89dbeac28960 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:14.606810 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:14.608197 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2ed9394-2521-4f27-bfb7-89dbeac28960 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:14.608841 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2ed9394-2521-4f27-bfb7-89dbeac28960 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:14.609361 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a2ed9394-2521-4f27-bfb7-89dbeac28960 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:14.614420 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:14.615797 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:14.616432 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:14.617850 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:14.618502 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:14.619199 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:14.689530 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a2ed9394-2521-4f27-bfb7-89dbeac28960 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:14.701243 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a2ed9394-2521-4f27-bfb7-89dbeac28960 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1265 microversion: 2.1 time: 0.109908 Sep 01 15:01:14.702444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 186/359] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:14 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:14.793002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:14.801573 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:14.803813 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:14.805091 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f873be9a-99f4-4fdb-bfc0-366ac63f59de tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1721 microversion: 2.20 time: 0.203562 Sep 01 15:01:14.811122 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 174/360] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:14 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:01:15.523348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-57638cc4-652f-47af-89a7-1202b81d3aad tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:15.523965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-57638cc4-652f-47af-89a7-1202b81d3aad tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:15.530494 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57638cc4-652f-47af-89a7-1202b81d3aad tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:15.530984 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57638cc4-652f-47af-89a7-1202b81d3aad tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:15.531426 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57638cc4-652f-47af-89a7-1202b81d3aad tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:15.532116 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57638cc4-652f-47af-89a7-1202b81d3aad tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:15.532643 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57638cc4-652f-47af-89a7-1202b81d3aad tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:15.533003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57638cc4-652f-47af-89a7-1202b81d3aad tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:15.666221 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-57638cc4-652f-47af-89a7-1202b81d3aad tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:15.674613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-57638cc4-652f-47af-89a7-1202b81d3aad tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1715 microversion: 2.1 time: 0.155580 Sep 01 15:01:15.675175 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 187/361] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:15 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:15.722199 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3ae4bfdb-b4ef-42fb-abb9-5fd3d1de8b1a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:15.722854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3ae4bfdb-b4ef-42fb-abb9-5fd3d1de8b1a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:15.729995 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ae4bfdb-b4ef-42fb-abb9-5fd3d1de8b1a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:15.730666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ae4bfdb-b4ef-42fb-abb9-5fd3d1de8b1a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:15.731156 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ae4bfdb-b4ef-42fb-abb9-5fd3d1de8b1a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:15.731869 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ae4bfdb-b4ef-42fb-abb9-5fd3d1de8b1a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:15.732337 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ae4bfdb-b4ef-42fb-abb9-5fd3d1de8b1a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:15.732770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ae4bfdb-b4ef-42fb-abb9-5fd3d1de8b1a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:15.797989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3ae4bfdb-b4ef-42fb-abb9-5fd3d1de8b1a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:15.807305 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3ae4bfdb-b4ef-42fb-abb9-5fd3d1de8b1a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1265 microversion: 2.1 time: 0.089072 Sep 01 15:01:15.807875 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 175/362] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:15 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:15.832906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:15.833616 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:15.839762 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:15.840227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:15.840672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:15.841430 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:15.841965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:15.842434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:15.972092 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:15.980324 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:15.981813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:15.983111 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-37afbb5f-919f-4615-bc8c-3bb02ed56793 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1721 microversion: 2.20 time: 0.154231 Sep 01 15:01:15.983745 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 188/363] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:15 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:16.827352 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7d286bbb-9c3b-4b8e-bacd-e88dfc20dcb2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:16.827967 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7d286bbb-9c3b-4b8e-bacd-e88dfc20dcb2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:16.835072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d286bbb-9c3b-4b8e-bacd-e88dfc20dcb2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:16.835554 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d286bbb-9c3b-4b8e-bacd-e88dfc20dcb2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:16.835993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d286bbb-9c3b-4b8e-bacd-e88dfc20dcb2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:16.836702 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d286bbb-9c3b-4b8e-bacd-e88dfc20dcb2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:16.837168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d286bbb-9c3b-4b8e-bacd-e88dfc20dcb2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:16.837597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d286bbb-9c3b-4b8e-bacd-e88dfc20dcb2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:16.900235 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7d286bbb-9c3b-4b8e-bacd-e88dfc20dcb2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:16.907804 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7d286bbb-9c3b-4b8e-bacd-e88dfc20dcb2 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1265 microversion: 2.1 time: 0.084326 Sep 01 15:01:16.908355 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 176/364] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:16 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:17.006669 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:17.007373 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:17.013478 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:17.013962 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:17.014430 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:17.015126 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:17.015574 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:17.015997 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:17.148652 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:17.157191 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:17.158740 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:17.159983 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-3d57db44-8583-43b9-b56f-064804627a16 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1721 microversion: 2.20 time: 0.157913 Sep 01 15:01:17.160547 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 189/365] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:17 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:17.928108 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-07c20c56-9155-4110-98e3-ff5736a64f4b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:17.929285 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-07c20c56-9155-4110-98e3-ff5736a64f4b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:17.935834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07c20c56-9155-4110-98e3-ff5736a64f4b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:17.936318 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07c20c56-9155-4110-98e3-ff5736a64f4b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:17.936753 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07c20c56-9155-4110-98e3-ff5736a64f4b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:17.937444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07c20c56-9155-4110-98e3-ff5736a64f4b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:17.937900 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07c20c56-9155-4110-98e3-ff5736a64f4b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:17.938640 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07c20c56-9155-4110-98e3-ff5736a64f4b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:18.019769 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-07c20c56-9155-4110-98e3-ff5736a64f4b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:18.029042 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-07c20c56-9155-4110-98e3-ff5736a64f4b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1271 microversion: 2.1 time: 0.104991 Sep 01 15:01:18.029844 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 177/366] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:17 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:18.182488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:18.183032 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:18.189842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:18.190353 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:18.190797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:18.191487 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:18.191939 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:18.192365 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:18.208420 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:18.272965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-ce7d0e50-2a19-4b69-b838-280df1c73850 req-9ea21f9f-08c9-49c7-9783-69be7afd98af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2570eed9-40bd-40ef-92d6-63b4e3cc83bf", "name": "network-vif-unplugged", "status": "completed", "tag": "2edcc91b-b083-48b1-bb53-84caae283791"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:18.292650 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-ce7d0e50-2a19-4b69-b838-280df1c73850 req-9ea21f9f-08c9-49c7-9783-69be7afd98af service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:18.293136 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-ce7d0e50-2a19-4b69-b838-280df1c73850 req-9ea21f9f-08c9-49c7-9783-69be7afd98af service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:18.293738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-ce7d0e50-2a19-4b69-b838-280df1c73850 req-9ea21f9f-08c9-49c7-9783-69be7afd98af service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:18.311950 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-ce7d0e50-2a19-4b69-b838-280df1c73850 req-9ea21f9f-08c9-49c7-9783-69be7afd98af service nova] Creating event network-vif-unplugged:2edcc91b-b083-48b1-bb53-84caae283791 for instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf on hv-cinder-85505 Sep 01 15:01:18.320360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-ce7d0e50-2a19-4b69-b838-280df1c73850 req-9ea21f9f-08c9-49c7-9783-69be7afd98af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052444 Sep 01 15:01:18.321836 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 178/367] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:18.399940 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:18.408964 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:18.411422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:18.413168 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-847f7309-dcea-4486-8aaf-ab0ddda80752 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1724 microversion: 2.20 time: 0.234478 Sep 01 15:01:18.414390 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 190/368] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:18 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:18.443173 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-44359cf4-cd97-4004-8d8d-3c1b139d90db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd83018b-46e8-4101-97cb-4d3c4118aedc"}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:18.446292 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-44359cf4-cd97-4004-8d8d-3c1b139d90db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:18.452864 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44359cf4-cd97-4004-8d8d-3c1b139d90db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:18.453352 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44359cf4-cd97-4004-8d8d-3c1b139d90db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:18.453821 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44359cf4-cd97-4004-8d8d-3c1b139d90db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:18.454552 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44359cf4-cd97-4004-8d8d-3c1b139d90db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:18.455011 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44359cf4-cd97-4004-8d8d-3c1b139d90db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:18.455437 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44359cf4-cd97-4004-8d8d-3c1b139d90db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:18.805736 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-44359cf4-cd97-4004-8d8d-3c1b139d90db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "POST /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.370950 Sep 01 15:01:18.806716 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 179/369] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Sep 1 15:01:18 2022] POST /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments => generated 188 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 15:01:18.964556 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e1fe9872-4f58-42f3-b0a8-c09a477fd32b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:18.965223 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e1fe9872-4f58-42f3-b0a8-c09a477fd32b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:18.971575 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e1fe9872-4f58-42f3-b0a8-c09a477fd32b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:18.972068 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e1fe9872-4f58-42f3-b0a8-c09a477fd32b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:18.972508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e1fe9872-4f58-42f3-b0a8-c09a477fd32b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:18.973207 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e1fe9872-4f58-42f3-b0a8-c09a477fd32b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:18.973667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e1fe9872-4f58-42f3-b0a8-c09a477fd32b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:18.974093 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e1fe9872-4f58-42f3-b0a8-c09a477fd32b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:19.019068 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:19.024392 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e1fe9872-4f58-42f3-b0a8-c09a477fd32b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120553) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 15:01:19.040941 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-030dbee8-f767-409c-8242-cd90795d2d82 req-6202f623-3de4-4bd4-9b96-fd507c60d679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53623c08-1cee-4d8d-b22a-ead2c54619cd", "tag": "bb21c5c7-135f-46ce-8ac0-7d4c6a4173b9"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:19.055076 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-030dbee8-f767-409c-8242-cd90795d2d82 req-6202f623-3de4-4bd4-9b96-fd507c60d679 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:19.055842 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-030dbee8-f767-409c-8242-cd90795d2d82 req-6202f623-3de4-4bd4-9b96-fd507c60d679 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:19.056426 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-030dbee8-f767-409c-8242-cd90795d2d82 req-6202f623-3de4-4bd4-9b96-fd507c60d679 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:19.067861 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-030dbee8-f767-409c-8242-cd90795d2d82 req-6202f623-3de4-4bd4-9b96-fd507c60d679 service nova] Creating event network-changed:bb21c5c7-135f-46ce-8ac0-7d4c6a4173b9 for instance 53623c08-1cee-4d8d-b22a-ead2c54619cd on hv-cinder-85505 Sep 01 15:01:19.073389 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-030dbee8-f767-409c-8242-cd90795d2d82 req-6202f623-3de4-4bd4-9b96-fd507c60d679 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037037 Sep 01 15:01:19.074285 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 180/370] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:01:19.081361 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-aa1350bb-6467-463e-9403-370c99b7bc99 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:19.082512 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-aa1350bb-6467-463e-9403-370c99b7bc99 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:19.089151 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa1350bb-6467-463e-9403-370c99b7bc99 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:19.089852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa1350bb-6467-463e-9403-370c99b7bc99 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:19.090486 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa1350bb-6467-463e-9403-370c99b7bc99 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:19.091333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa1350bb-6467-463e-9403-370c99b7bc99 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:19.092071 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa1350bb-6467-463e-9403-370c99b7bc99 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:19.092643 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aa1350bb-6467-463e-9403-370c99b7bc99 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:19.131898 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e1fe9872-4f58-42f3-b0a8-c09a477fd32b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "POST /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/action" status: 202 len: 0 microversion: 2.20 time: 0.172253 Sep 01 15:01:19.132920 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 191/371] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Sep 1 15:01:18 2022] POST /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:01:19.141695 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:19.142366 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:19.152026 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:19.152692 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:19.153133 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:19.154083 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:19.154951 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:19.155393 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:19.362501 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:19.372282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:19.373747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:19.374966 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1a371797-eaf4-4786-85ff-f9c637492276 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1750 microversion: 2.20 time: 0.238076 Sep 01 15:01:19.375571 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 192/372] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:19 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1750 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:19.381637 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-aa1350bb-6467-463e-9403-370c99b7bc99 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:19.392463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-aa1350bb-6467-463e-9403-370c99b7bc99 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.316679 Sep 01 15:01:19.394782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 181/373] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:19 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:20.397061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:20.397672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:20.403655 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:20.404140 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:20.404583 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:20.405275 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:20.405737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:20.406200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:20.414622 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-380e67b2-560c-48b5-97af-8242793ae4bd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:20.415773 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-380e67b2-560c-48b5-97af-8242793ae4bd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:20.422358 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-380e67b2-560c-48b5-97af-8242793ae4bd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:20.422876 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-380e67b2-560c-48b5-97af-8242793ae4bd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:20.423306 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-380e67b2-560c-48b5-97af-8242793ae4bd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:20.423993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-380e67b2-560c-48b5-97af-8242793ae4bd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:20.424451 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-380e67b2-560c-48b5-97af-8242793ae4bd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:20.424897 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-380e67b2-560c-48b5-97af-8242793ae4bd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:20.548815 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:20.562091 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:20.563597 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:20.563947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-380e67b2-560c-48b5-97af-8242793ae4bd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:20.564818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1c2dd030-3eed-4fb9-9edd-e55186b74760 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1750 microversion: 2.20 time: 0.171791 Sep 01 15:01:20.565378 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 193/374] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:20 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:20.571731 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-380e67b2-560c-48b5-97af-8242793ae4bd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.160865 Sep 01 15:01:20.572276 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 182/375] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:20 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:21.594833 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:21.595441 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:21.596564 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-37c8f544-7f5e-46c0-9ef3-82d495109903 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:21.597741 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-37c8f544-7f5e-46c0-9ef3-82d495109903 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:21.608838 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-37c8f544-7f5e-46c0-9ef3-82d495109903 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:21.609774 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:21.610484 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:21.611232 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:21.612085 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:21.612874 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:21.613416 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-37c8f544-7f5e-46c0-9ef3-82d495109903 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:21.613632 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:21.614398 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-37c8f544-7f5e-46c0-9ef3-82d495109903 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:21.615125 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-37c8f544-7f5e-46c0-9ef3-82d495109903 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:21.616178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-37c8f544-7f5e-46c0-9ef3-82d495109903 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:21.616603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-37c8f544-7f5e-46c0-9ef3-82d495109903 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:21.790642 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:21.799971 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:21.801655 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:21.803118 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4a6adb5b-86c0-463a-8e57-dbfe88a3eda2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.219428 Sep 01 15:01:21.804023 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 194/376] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:21 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:21.824751 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-37c8f544-7f5e-46c0-9ef3-82d495109903 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:21.833519 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-37c8f544-7f5e-46c0-9ef3-82d495109903 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.246333 Sep 01 15:01:21.834712 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 183/377] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:21 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:22.825921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:22.827375 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:22.837532 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:22.838043 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:22.838512 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:22.839681 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:22.840329 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:22.840936 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:22.855928 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-de01e372-dd66-4cf1-af15-c46b8aea5f3f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:22.856550 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-de01e372-dd66-4cf1-af15-c46b8aea5f3f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:22.864436 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de01e372-dd66-4cf1-af15-c46b8aea5f3f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:22.866023 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de01e372-dd66-4cf1-af15-c46b8aea5f3f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:22.867072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de01e372-dd66-4cf1-af15-c46b8aea5f3f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:22.868175 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de01e372-dd66-4cf1-af15-c46b8aea5f3f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:22.870228 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de01e372-dd66-4cf1-af15-c46b8aea5f3f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:22.871914 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de01e372-dd66-4cf1-af15-c46b8aea5f3f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:22.974540 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:23.055843 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:23.067262 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:23.068748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:23.069920 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f118ee15-a55f-4f47-8287-b2c955db4b96 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.248257 Sep 01 15:01:23.086661 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 195/378] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:22 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:23.112485 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-de01e372-dd66-4cf1-af15-c46b8aea5f3f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:23.120793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-de01e372-dd66-4cf1-af15-c46b8aea5f3f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.269319 Sep 01 15:01:23.121345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 184/379] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:22 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:24.093813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:24.094620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:24.097585 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=8 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:24.105648 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:24.112086 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:24.112578 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:24.113315 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:24.113792 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:24.114215 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:24.145815 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1a3e0d18-6e60-4b46-8fba-5037b9c537d0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:24.146521 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-1a3e0d18-6e60-4b46-8fba-5037b9c537d0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:24.157375 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e0d18-6e60-4b46-8fba-5037b9c537d0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:24.159413 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e0d18-6e60-4b46-8fba-5037b9c537d0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:24.163542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e0d18-6e60-4b46-8fba-5037b9c537d0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:24.164840 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e0d18-6e60-4b46-8fba-5037b9c537d0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:24.165720 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e0d18-6e60-4b46-8fba-5037b9c537d0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:24.166545 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e0d18-6e60-4b46-8fba-5037b9c537d0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:24.399977 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:24.413938 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:24.415628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:24.416987 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e45be446-37e7-44e0-bb0b-7a9db6706ba9 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.327837 Sep 01 15:01:24.418087 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 196/380] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:24 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:24.429096 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1a3e0d18-6e60-4b46-8fba-5037b9c537d0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:24.438658 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-1a3e0d18-6e60-4b46-8fba-5037b9c537d0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.300179 Sep 01 15:01:24.455896 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 185/381] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:24 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:24.511441 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-97df7fc9-3de1-423c-a79f-49de28c56a43 req-0a519859-154d-4cef-83ce-fe775fcced68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53623c08-1cee-4d8d-b22a-ead2c54619cd", "name": "network-vif-plugged", "status": "completed", "tag": "bb21c5c7-135f-46ce-8ac0-7d4c6a4173b9"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:24.537610 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-97df7fc9-3de1-423c-a79f-49de28c56a43 req-0a519859-154d-4cef-83ce-fe775fcced68 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:24.538699 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-97df7fc9-3de1-423c-a79f-49de28c56a43 req-0a519859-154d-4cef-83ce-fe775fcced68 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:24.539379 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-97df7fc9-3de1-423c-a79f-49de28c56a43 req-0a519859-154d-4cef-83ce-fe775fcced68 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:24.571470 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-97df7fc9-3de1-423c-a79f-49de28c56a43 req-0a519859-154d-4cef-83ce-fe775fcced68 service nova] Creating event network-vif-plugged:bb21c5c7-135f-46ce-8ac0-7d4c6a4173b9 for instance 53623c08-1cee-4d8d-b22a-ead2c54619cd on hv-cinder-85505 Sep 01 15:01:24.582341 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-97df7fc9-3de1-423c-a79f-49de28c56a43 req-0a519859-154d-4cef-83ce-fe775fcced68 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074446 Sep 01 15:01:24.585375 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 197/382] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:25.445258 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:25.446436 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:25.452714 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:25.453208 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:25.453647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:25.455186 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:25.455812 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:25.456258 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:25.463528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c4723b33-e147-4718-84e8-ef6a9361b9e3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:25.465031 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c4723b33-e147-4718-84e8-ef6a9361b9e3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:25.482328 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4723b33-e147-4718-84e8-ef6a9361b9e3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:25.484929 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4723b33-e147-4718-84e8-ef6a9361b9e3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:25.485779 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4723b33-e147-4718-84e8-ef6a9361b9e3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:25.487071 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4723b33-e147-4718-84e8-ef6a9361b9e3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:25.487696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4723b33-e147-4718-84e8-ef6a9361b9e3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:25.488300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4723b33-e147-4718-84e8-ef6a9361b9e3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:25.713167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:25.724058 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:25.726096 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:25.727542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0c03f77e-a4f3-4906-b19e-78ebba2abe51 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.286781 Sep 01 15:01:25.728565 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 186/383] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:25 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:25.765781 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c4723b33-e147-4718-84e8-ef6a9361b9e3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:25.776500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c4723b33-e147-4718-84e8-ef6a9361b9e3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.319246 Sep 01 15:01:25.777627 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 198/384] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:25 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:26.756484 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:26.757187 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:26.763089 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:26.763570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:26.764003 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:26.764691 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:26.765144 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:26.767924 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:26.797798 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b9011de6-4e4d-4f61-877f-5a21351ab4e5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:26.798455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b9011de6-4e4d-4f61-877f-5a21351ab4e5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:26.805804 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b9011de6-4e4d-4f61-877f-5a21351ab4e5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:26.814028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b9011de6-4e4d-4f61-877f-5a21351ab4e5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:26.814528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b9011de6-4e4d-4f61-877f-5a21351ab4e5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:26.815282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b9011de6-4e4d-4f61-877f-5a21351ab4e5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:26.815756 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b9011de6-4e4d-4f61-877f-5a21351ab4e5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:26.816219 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b9011de6-4e4d-4f61-877f-5a21351ab4e5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:26.930899 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:26.939641 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:26.941350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:26.942838 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-191e536b-38e5-4945-801e-6a36387052dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.190513 Sep 01 15:01:26.943610 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 187/385] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:26 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:26.987173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b9011de6-4e4d-4f61-877f-5a21351ab4e5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:26.995900 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b9011de6-4e4d-4f61-877f-5a21351ab4e5 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.202203 Sep 01 15:01:26.996541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 199/386] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:26 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:27.967594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:27.968192 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:27.975367 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:27.975849 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:27.976293 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:27.976997 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:27.977447 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:27.977871 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:28.016399 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-836f8cce-3894-4fa3-8ef3-d1bf4636a28c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:28.017250 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-836f8cce-3894-4fa3-8ef3-d1bf4636a28c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:28.023369 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-836f8cce-3894-4fa3-8ef3-d1bf4636a28c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:28.023865 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-836f8cce-3894-4fa3-8ef3-d1bf4636a28c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:28.024302 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-836f8cce-3894-4fa3-8ef3-d1bf4636a28c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:28.025053 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-836f8cce-3894-4fa3-8ef3-d1bf4636a28c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:28.025592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-836f8cce-3894-4fa3-8ef3-d1bf4636a28c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:28.026015 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-836f8cce-3894-4fa3-8ef3-d1bf4636a28c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:28.136607 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:28.159305 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:28.161248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:28.163346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3dab44b3-4be0-4e60-98f0-f41c90a50008 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.199783 Sep 01 15:01:28.164438 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 188/387] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:27 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:01:28.179597 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-836f8cce-3894-4fa3-8ef3-d1bf4636a28c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:28.187244 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-836f8cce-3894-4fa3-8ef3-d1bf4636a28c tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.174574 Sep 01 15:01:28.187792 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 200/388] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:28 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:29.187783 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:29.188571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:29.196461 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:29.202831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:29.203478 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:29.204289 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:29.204831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:29.205482 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:29.207854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bea41a05-79c4-4853-92c4-c9a44f030eab tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:29.209572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-bea41a05-79c4-4853-92c4-c9a44f030eab tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:29.210624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:29.223588 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bea41a05-79c4-4853-92c4-c9a44f030eab tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:29.224395 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bea41a05-79c4-4853-92c4-c9a44f030eab tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:29.225366 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bea41a05-79c4-4853-92c4-c9a44f030eab tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:29.226083 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bea41a05-79c4-4853-92c4-c9a44f030eab tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:29.226891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bea41a05-79c4-4853-92c4-c9a44f030eab tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:29.227471 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bea41a05-79c4-4853-92c4-c9a44f030eab tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:29.392866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:29.403203 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:29.404934 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:29.406372 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-44ea6e07-6fff-4d68-9aec-1a2cc5ff5743 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.222507 Sep 01 15:01:29.407050 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 189/389] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:29 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:29.436799 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-bea41a05-79c4-4853-92c4-c9a44f030eab tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:29.445483 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-bea41a05-79c4-4853-92c4-c9a44f030eab tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.241582 Sep 01 15:01:29.446218 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 201/390] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:29 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:30.430006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:30.430565 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:30.437009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:30.437495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:30.438711 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:30.439537 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:30.440003 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:30.440433 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:30.464870 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-155752cf-1013-435f-ba5b-f8f7963e5464 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:30.465489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-155752cf-1013-435f-ba5b-f8f7963e5464 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:30.471756 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-155752cf-1013-435f-ba5b-f8f7963e5464 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:30.472407 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-155752cf-1013-435f-ba5b-f8f7963e5464 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:30.472950 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-155752cf-1013-435f-ba5b-f8f7963e5464 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:30.473761 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-155752cf-1013-435f-ba5b-f8f7963e5464 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:30.474842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-155752cf-1013-435f-ba5b-f8f7963e5464 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:30.475400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-155752cf-1013-435f-ba5b-f8f7963e5464 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:30.584363 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:30.593268 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:30.595201 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:30.596833 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9d1b45bf-2ceb-4ef0-90e8-bf040b5a4911 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.171440 Sep 01 15:01:30.597498 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 190/391] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:30 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:30.622424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-155752cf-1013-435f-ba5b-f8f7963e5464 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:30.630722 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-155752cf-1013-435f-ba5b-f8f7963e5464 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.169535 Sep 01 15:01:30.631292 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 202/392] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:30 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:31.620594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:31.621239 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:31.627826 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:31.628315 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:31.628748 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:31.629443 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:31.629895 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:31.630358 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:31.650967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-76ada5ed-8b58-4e39-96b4-1b301b992d9b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:31.651600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-76ada5ed-8b58-4e39-96b4-1b301b992d9b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:31.659413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76ada5ed-8b58-4e39-96b4-1b301b992d9b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:31.659973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76ada5ed-8b58-4e39-96b4-1b301b992d9b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:31.660424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76ada5ed-8b58-4e39-96b4-1b301b992d9b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:31.661141 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76ada5ed-8b58-4e39-96b4-1b301b992d9b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:31.661614 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76ada5ed-8b58-4e39-96b4-1b301b992d9b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:31.662046 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-76ada5ed-8b58-4e39-96b4-1b301b992d9b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:31.797544 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:31.797924 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-76ada5ed-8b58-4e39-96b4-1b301b992d9b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:31.806435 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-76ada5ed-8b58-4e39-96b4-1b301b992d9b tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.159242 Sep 01 15:01:31.806991 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 203/393] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:31 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:31.807120 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:31.808547 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:31.809704 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b1520726-fb03-4549-92cd-2d385bcd0a57 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.193630 Sep 01 15:01:31.810261 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 191/394] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:31 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:32.321908 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a733a884-b50f-4f73-940f-f3631c04747e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bb7b845-0da5-45d7-b519-de1910ea1828", "device": "/dev/sdb"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:32.325950 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a733a884-b50f-4f73-940f-f3631c04747e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:32.332314 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a733a884-b50f-4f73-940f-f3631c04747e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:32.332807 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a733a884-b50f-4f73-940f-f3631c04747e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:32.333249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a733a884-b50f-4f73-940f-f3631c04747e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:32.333992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a733a884-b50f-4f73-940f-f3631c04747e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:32.334480 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a733a884-b50f-4f73-940f-f3631c04747e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:32.334910 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a733a884-b50f-4f73-940f-f3631c04747e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:32.826721 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d003f60b-24d4-438b-a124-8810b42b772a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:32.828176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d003f60b-24d4-438b-a124-8810b42b772a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:32.835069 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d003f60b-24d4-438b-a124-8810b42b772a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:32.835559 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d003f60b-24d4-438b-a124-8810b42b772a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:32.835997 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d003f60b-24d4-438b-a124-8810b42b772a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:32.836817 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d003f60b-24d4-438b-a124-8810b42b772a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:32.837597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d003f60b-24d4-438b-a124-8810b42b772a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:32.838265 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d003f60b-24d4-438b-a124-8810b42b772a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:32.973875 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d003f60b-24d4-438b-a124-8810b42b772a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:32.981692 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d003f60b-24d4-438b-a124-8810b42b772a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.158821 Sep 01 15:01:32.982280 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 192/395] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:32 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:32.986705 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:32.987311 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:32.993677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:32.994161 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:32.994623 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:32.995309 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:32.995763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:32.996184 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:33.142808 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:33.151418 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:33.152846 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:33.154593 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ea1ddcfd-aaa5-44e6-8f6b-2a25d069ce71 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.170940 Sep 01 15:01:33.155293 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 193/396] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:32 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:34.004544 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7a68ed27-d811-4e96-8fe9-ced896342d59 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:34.005364 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7a68ed27-d811-4e96-8fe9-ced896342d59 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:34.008043 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=88 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:34.013304 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7a68ed27-d811-4e96-8fe9-ced896342d59 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:34.013795 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7a68ed27-d811-4e96-8fe9-ced896342d59 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:34.014947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7a68ed27-d811-4e96-8fe9-ced896342d59 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:34.015711 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7a68ed27-d811-4e96-8fe9-ced896342d59 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:34.016187 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7a68ed27-d811-4e96-8fe9-ced896342d59 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:34.016624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7a68ed27-d811-4e96-8fe9-ced896342d59 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:34.152294 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7a68ed27-d811-4e96-8fe9-ced896342d59 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:34.160989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7a68ed27-d811-4e96-8fe9-ced896342d59 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.161017 Sep 01 15:01:34.161635 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 194/397] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:33 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:34.178970 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:34.179582 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:34.185469 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:34.185948 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:34.186413 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:34.187206 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:34.187661 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:34.188081 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:34.318599 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:34.327562 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:34.328983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:34.330170 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e53355c9-9977-4534-bab2-c4dbcc3c2448 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.155268 Sep 01 15:01:34.330800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 195/398] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:34 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:35.182106 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-957137e7-f703-4211-986f-f8033af7e8a9 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:35.182783 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-957137e7-f703-4211-986f-f8033af7e8a9 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:35.189263 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-957137e7-f703-4211-986f-f8033af7e8a9 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:35.189749 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-957137e7-f703-4211-986f-f8033af7e8a9 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:35.190184 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-957137e7-f703-4211-986f-f8033af7e8a9 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:35.190895 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-957137e7-f703-4211-986f-f8033af7e8a9 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:35.191345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-957137e7-f703-4211-986f-f8033af7e8a9 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:35.191794 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-957137e7-f703-4211-986f-f8033af7e8a9 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:35.322627 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-957137e7-f703-4211-986f-f8033af7e8a9 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:35.330421 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-957137e7-f703-4211-986f-f8033af7e8a9 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.152028 Sep 01 15:01:35.330985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 196/399] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:35 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:01:35.352385 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:35.352990 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:35.358626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:35.359112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:35.359555 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:35.360241 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:35.360700 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:35.361128 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:35.489045 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:35.498159 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:35.499625 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:35.500773 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7e404fe6-51ce-4d69-868d-b4a921401f7d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.151988 Sep 01 15:01:35.501339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 197/400] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:35 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:01:35.658867 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a733a884-b50f-4f73-940f-f3631c04747e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "POST /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.341707 Sep 01 15:01:35.665013 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 204/401] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:01:32 2022] POST /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e/os-volume_attachments => generated 194 bytes in 3343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:36.351125 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3f556c02-be83-4915-b29e-f68dd9e42d41 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:36.351798 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3f556c02-be83-4915-b29e-f68dd9e42d41 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:36.358207 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f556c02-be83-4915-b29e-f68dd9e42d41 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:36.358724 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f556c02-be83-4915-b29e-f68dd9e42d41 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:36.359165 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f556c02-be83-4915-b29e-f68dd9e42d41 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:36.359856 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f556c02-be83-4915-b29e-f68dd9e42d41 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:36.360316 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f556c02-be83-4915-b29e-f68dd9e42d41 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:36.360746 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f556c02-be83-4915-b29e-f68dd9e42d41 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:36.488415 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3f556c02-be83-4915-b29e-f68dd9e42d41 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:36.496089 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3f556c02-be83-4915-b29e-f68dd9e42d41 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.148831 Sep 01 15:01:36.496648 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 198/402] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:36 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:36.525217 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:36.525926 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:36.532088 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:36.532580 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:36.533023 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:36.533752 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:36.534223 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:36.534678 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:36.549187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:36.667747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:36.676566 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:36.678546 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:36.679700 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f8a572dd-b3f5-4428-8620-b54ffbf9ad39 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.159973 Sep 01 15:01:36.680256 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 205/403] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:36 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:37.516783 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3c4ec023-033f-441a-aeb0-b1f73a19c5fd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:37.517318 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3c4ec023-033f-441a-aeb0-b1f73a19c5fd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:37.524317 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c4ec023-033f-441a-aeb0-b1f73a19c5fd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:37.524802 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c4ec023-033f-441a-aeb0-b1f73a19c5fd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:37.525241 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c4ec023-033f-441a-aeb0-b1f73a19c5fd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:37.525925 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c4ec023-033f-441a-aeb0-b1f73a19c5fd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:37.526422 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c4ec023-033f-441a-aeb0-b1f73a19c5fd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:37.526851 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c4ec023-033f-441a-aeb0-b1f73a19c5fd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:37.656207 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3c4ec023-033f-441a-aeb0-b1f73a19c5fd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:37.664450 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3c4ec023-033f-441a-aeb0-b1f73a19c5fd tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1313 microversion: 2.1 time: 0.151592 Sep 01 15:01:37.665008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 199/404] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:37 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:37.702552 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:37.703207 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:37.710257 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:37.710759 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:37.711201 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:37.711899 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:37.712363 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:37.712795 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:37.845730 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:37.854200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:37.855677 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:37.856842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-79dcf559-b400-446a-b169-5674d8540f52 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.158228 Sep 01 15:01:37.857391 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 206/405] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:37 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:38.685598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a78a05ac-301d-4960-bbb1-1d97b8e7847f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:38.686160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a78a05ac-301d-4960-bbb1-1d97b8e7847f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:38.693011 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a78a05ac-301d-4960-bbb1-1d97b8e7847f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:38.693501 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a78a05ac-301d-4960-bbb1-1d97b8e7847f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:38.693938 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a78a05ac-301d-4960-bbb1-1d97b8e7847f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:38.694694 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a78a05ac-301d-4960-bbb1-1d97b8e7847f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:38.695151 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a78a05ac-301d-4960-bbb1-1d97b8e7847f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:38.695574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a78a05ac-301d-4960-bbb1-1d97b8e7847f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:38.821329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a78a05ac-301d-4960-bbb1-1d97b8e7847f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:38.828969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a78a05ac-301d-4960-bbb1-1d97b8e7847f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1497 microversion: 2.1 time: 0.147338 Sep 01 15:01:38.829528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 200/406] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:38 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:38.880346 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:38.882210 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:38.889302 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:38.890060 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:38.890990 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:38.892150 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:38.892673 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:38.893524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:39.035555 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:39.044872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:39.046377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:39.047534 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6d35a702-ff81-42f2-827e-c0c324701434 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.172321 Sep 01 15:01:39.048151 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 207/407] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:38 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:39.445530 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-72047dde-c70b-4433-8bb8-6083e09647f1 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:39.446028 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-72047dde-c70b-4433-8bb8-6083e09647f1 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:39.452218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72047dde-c70b-4433-8bb8-6083e09647f1 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:39.452793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72047dde-c70b-4433-8bb8-6083e09647f1 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:39.453364 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72047dde-c70b-4433-8bb8-6083e09647f1 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:39.454474 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72047dde-c70b-4433-8bb8-6083e09647f1 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:39.454603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72047dde-c70b-4433-8bb8-6083e09647f1 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:39.455001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72047dde-c70b-4433-8bb8-6083e09647f1 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:39.481041 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-72047dde-c70b-4433-8bb8-6083e09647f1 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:01:39.557691 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-72047dde-c70b-4433-8bb8-6083e09647f1 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "DELETE /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 204 len: 0 microversion: 2.1 time: 0.116501 Sep 01 15:01:39.558275 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 201/408] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:01:39 2022] DELETE /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:01:39.566447 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b0d66058-42d7-4da9-b100-77fee40a2b57 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:39.567144 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b0d66058-42d7-4da9-b100-77fee40a2b57 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:39.573783 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0d66058-42d7-4da9-b100-77fee40a2b57 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:39.574426 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0d66058-42d7-4da9-b100-77fee40a2b57 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:39.574926 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0d66058-42d7-4da9-b100-77fee40a2b57 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:39.575701 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0d66058-42d7-4da9-b100-77fee40a2b57 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:39.576710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0d66058-42d7-4da9-b100-77fee40a2b57 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:39.577098 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b0d66058-42d7-4da9-b100-77fee40a2b57 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:39.707433 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b0d66058-42d7-4da9-b100-77fee40a2b57 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:39.715163 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b0d66058-42d7-4da9-b100-77fee40a2b57 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1503 microversion: 2.1 time: 0.152602 Sep 01 15:01:39.715715 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 208/409] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:39 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:40.071710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:40.072559 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:40.079737 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:40.080232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:40.080677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:40.081386 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:40.081858 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:40.082314 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:40.237690 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:40.247020 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:40.248470 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:40.249628 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-691ee003-eabf-446f-9625-bb12ed801c4f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.182605 Sep 01 15:01:40.250183 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 202/410] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:40 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:40.528846 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-270e0439-b88d-420b-83d9-de5113488f88 req-91e970cc-5958-491e-bce0-ee8c6410fbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2570eed9-40bd-40ef-92d6-63b4e3cc83bf", "name": "network-vif-plugged", "status": "completed", "tag": "2edcc91b-b083-48b1-bb53-84caae283791"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:40.539073 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-270e0439-b88d-420b-83d9-de5113488f88 req-91e970cc-5958-491e-bce0-ee8c6410fbc4 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:40.539564 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-270e0439-b88d-420b-83d9-de5113488f88 req-91e970cc-5958-491e-bce0-ee8c6410fbc4 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:40.539995 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-270e0439-b88d-420b-83d9-de5113488f88 req-91e970cc-5958-491e-bce0-ee8c6410fbc4 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:40.551352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-270e0439-b88d-420b-83d9-de5113488f88 req-91e970cc-5958-491e-bce0-ee8c6410fbc4 service nova] Creating event network-vif-plugged:2edcc91b-b083-48b1-bb53-84caae283791 for instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf on hv-cinder-85505 Sep 01 15:01:40.556134 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-270e0439-b88d-420b-83d9-de5113488f88 req-91e970cc-5958-491e-bce0-ee8c6410fbc4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030892 Sep 01 15:01:40.556711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 209/411] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:40.735981 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-378bceb0-b00b-4c29-ad9f-effebdaa3f21 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:40.736614 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-378bceb0-b00b-4c29-ad9f-effebdaa3f21 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:40.742689 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-378bceb0-b00b-4c29-ad9f-effebdaa3f21 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:40.743173 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-378bceb0-b00b-4c29-ad9f-effebdaa3f21 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:40.743603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-378bceb0-b00b-4c29-ad9f-effebdaa3f21 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:40.744283 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-378bceb0-b00b-4c29-ad9f-effebdaa3f21 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:40.744733 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-378bceb0-b00b-4c29-ad9f-effebdaa3f21 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:40.745154 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-378bceb0-b00b-4c29-ad9f-effebdaa3f21 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:40.881377 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-378bceb0-b00b-4c29-ad9f-effebdaa3f21 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:40.889124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-378bceb0-b00b-4c29-ad9f-effebdaa3f21 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1503 microversion: 2.1 time: 0.157031 Sep 01 15:01:40.889677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 203/412] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:40 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:41.273137 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:41.273837 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:41.279884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:41.280363 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:41.280797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:41.281478 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:41.281954 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:41.282424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:41.410424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:41.419506 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:41.420949 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:41.422103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-08b8badf-7204-4a2e-bb91-23414199e4c0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.153775 Sep 01 15:01:41.422684 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 210/413] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:41 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:41.909857 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a4249507-98b6-4487-8297-46ba4d056eb3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:41.910528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a4249507-98b6-4487-8297-46ba4d056eb3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:41.916912 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4249507-98b6-4487-8297-46ba4d056eb3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:41.917339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4249507-98b6-4487-8297-46ba4d056eb3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:41.917775 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4249507-98b6-4487-8297-46ba4d056eb3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:41.918495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4249507-98b6-4487-8297-46ba4d056eb3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:41.918948 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4249507-98b6-4487-8297-46ba4d056eb3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:41.919369 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4249507-98b6-4487-8297-46ba4d056eb3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:41.922010 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:42.046161 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a4249507-98b6-4487-8297-46ba4d056eb3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:42.054612 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a4249507-98b6-4487-8297-46ba4d056eb3 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1503 microversion: 2.1 time: 0.148649 Sep 01 15:01:42.055180 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 204/414] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:41 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:42.444919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:42.445464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:42.451823 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:42.452284 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:42.452724 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:42.453397 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:42.453849 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:42.454291 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:42.580415 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:42.589326 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:42.590780 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:42.591924 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-30701d76-3433-4ca1-9e42-86827dc83595 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.150945 Sep 01 15:01:42.592463 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 211/415] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:42 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:43.075830 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3064fc90-1570-4daa-a489-81ea99857f6e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:43.076444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3064fc90-1570-4daa-a489-81ea99857f6e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:43.082923 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3064fc90-1570-4daa-a489-81ea99857f6e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:43.083408 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3064fc90-1570-4daa-a489-81ea99857f6e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:43.083844 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3064fc90-1570-4daa-a489-81ea99857f6e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:43.085153 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3064fc90-1570-4daa-a489-81ea99857f6e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:43.085608 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3064fc90-1570-4daa-a489-81ea99857f6e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:43.086034 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3064fc90-1570-4daa-a489-81ea99857f6e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:43.216061 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3064fc90-1570-4daa-a489-81ea99857f6e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:43.223669 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3064fc90-1570-4daa-a489-81ea99857f6e tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1503 microversion: 2.1 time: 0.151775 Sep 01 15:01:43.224218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 205/416] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:43 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:43.614671 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:43.615293 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:43.622335 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:43.622823 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:43.623267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:43.623959 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:43.624421 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:43.624862 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:43.752001 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:43.760587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:43.762040 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:43.763249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6f9f8a29-4554-44cb-973d-19385de8935d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.152623 Sep 01 15:01:43.763807 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 212/417] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:43 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:44.244664 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f5b01b19-7aa5-4b99-85f6-e3972dadf056 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:44.245279 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f5b01b19-7aa5-4b99-85f6-e3972dadf056 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:44.251418 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5b01b19-7aa5-4b99-85f6-e3972dadf056 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:44.251903 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5b01b19-7aa5-4b99-85f6-e3972dadf056 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:44.252339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5b01b19-7aa5-4b99-85f6-e3972dadf056 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:44.253031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5b01b19-7aa5-4b99-85f6-e3972dadf056 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:44.253485 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5b01b19-7aa5-4b99-85f6-e3972dadf056 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:44.253909 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5b01b19-7aa5-4b99-85f6-e3972dadf056 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:44.391259 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f5b01b19-7aa5-4b99-85f6-e3972dadf056 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:44.400472 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f5b01b19-7aa5-4b99-85f6-e3972dadf056 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1503 microversion: 2.1 time: 0.159542 Sep 01 15:01:44.401047 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 206/418] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:44 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:44.634805 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-1952db9e-ed0b-4860-be0e-abb6c1eba904 req-bf21e821-b3c6-44f1-a239-b4eaf48509ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53623c08-1cee-4d8d-b22a-ead2c54619cd", "name": "network-vif-deleted", "tag": "bb21c5c7-135f-46ce-8ac0-7d4c6a4173b9"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:01:44.648680 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-1952db9e-ed0b-4860-be0e-abb6c1eba904 req-bf21e821-b3c6-44f1-a239-b4eaf48509ef service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:44.649169 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-1952db9e-ed0b-4860-be0e-abb6c1eba904 req-bf21e821-b3c6-44f1-a239-b4eaf48509ef service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:44.649604 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-1952db9e-ed0b-4860-be0e-abb6c1eba904 req-bf21e821-b3c6-44f1-a239-b4eaf48509ef service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:44.667577 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-1952db9e-ed0b-4860-be0e-abb6c1eba904 req-bf21e821-b3c6-44f1-a239-b4eaf48509ef service nova] Creating event network-vif-deleted:bb21c5c7-135f-46ce-8ac0-7d4c6a4173b9 for instance 53623c08-1cee-4d8d-b22a-ead2c54619cd on hv-cinder-85505 Sep 01 15:01:44.672924 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-1952db9e-ed0b-4860-be0e-abb6c1eba904 req-bf21e821-b3c6-44f1-a239-b4eaf48509ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042379 Sep 01 15:01:44.673732 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 213/419] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:01:44.786610 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:44.787137 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:44.793537 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:44.794255 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:44.794720 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:44.795458 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:44.795975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:44.796449 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:44.925474 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:44.934548 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:44.935990 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:44.937143 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-32331d24-67ed-4e01-8c6c-7e55aba849b2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.154671 Sep 01 15:01:44.937696 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 207/420] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:44 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:01:45.421987 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:45.422718 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:45.430343 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:45.430838 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:45.431281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:45.431981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:45.432443 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:45.432873 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:45.462406 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:45.462892 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:45.463333 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:45.463778 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lazy-loading 'fault' on Instance uuid 53623c08-1cee-4d8d-b22a-ead2c54619cd {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:01:45.508937 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:45.516696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c6adef17-95a5-4ee2-a51b-b1231427b91a tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1303 microversion: 2.1 time: 0.098966 Sep 01 15:01:45.517247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 214/421] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:45 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:45.966935 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:45.967551 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:45.973930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:45.974450 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:45.975464 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:45.976161 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:45.976618 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:45.977039 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:46.104602 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:46.113148 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:46.114606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:46.115793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-667fb2e4-7c47-4a51-99cf-6bc5f1c06b2b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.152730 Sep 01 15:01:46.116344 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 208/422] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:45 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:46.536732 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:46.537502 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:46.544489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:46.544970 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:46.545405 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:46.546085 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:46.546576 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:46.546999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:46.576705 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:46.577175 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:46.577605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:46.578039 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lazy-loading 'fault' on Instance uuid 53623c08-1cee-4d8d-b22a-ead2c54619cd {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:01:46.617634 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:46.625107 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-af8a5f7f-308e-4dc2-a2df-df15a0c340f0 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1303 microversion: 2.1 time: 0.092197 Sep 01 15:01:46.625651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 215/423] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:46 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:47.138309 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:47.138923 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:47.145268 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:47.145750 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:47.146183 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:47.146944 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:47.147412 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:47.147888 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:47.278017 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:47.286682 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:47.288120 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:47.289282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3a09544b-ec18-4d86-a016-4d5fedf5ad4a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.154904 Sep 01 15:01:47.289832 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 209/424] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:47 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:47.644692 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:47.645311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:47.651728 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:47.652211 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:47.652644 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:47.653340 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:47.653789 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:47.654209 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:47.685580 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:47.686055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:47.686529 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:47.686968 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lazy-loading 'fault' on Instance uuid 53623c08-1cee-4d8d-b22a-ead2c54619cd {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:01:47.728408 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:47.735842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-52c03b6b-6748-4912-ba0c-16f6605e88c4 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1303 microversion: 2.1 time: 0.094975 Sep 01 15:01:47.736386 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 216/425] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:47 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:48.312634 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:48.313246 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:48.321571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:48.322157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:48.322680 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:48.323439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:48.323963 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:48.324389 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:48.451108 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:48.460154 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:48.461579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:48.462779 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f220ca45-552f-493d-8f3d-f5842f877807 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.154146 Sep 01 15:01:48.463318 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 210/426] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:48 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:48.757729 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:48.758421 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:48.768656 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:48.769157 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:48.769595 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:48.770334 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:48.770797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:48.771310 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:48.803725 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:48.804214 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:48.804662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:48.805107 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lazy-loading 'fault' on Instance uuid 53623c08-1cee-4d8d-b22a-ead2c54619cd {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:01:48.847300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:48.855436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-56516eea-b110-4bd2-89dc-29769cbac458 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1303 microversion: 2.1 time: 0.102141 Sep 01 15:01:48.855993 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 217/427] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:48 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:49.484843 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:49.485397 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:49.492101 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:49.492579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:49.493014 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:49.493694 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:49.494148 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:49.494593 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:49.622532 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:49.631127 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:49.633048 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:49.634195 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ab741e81-787e-493e-ae80-bf8cec717c80 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.153251 Sep 01 15:01:49.634838 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 211/428] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:49 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:49.875710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:49.876326 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:49.878775 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:49.883921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:49.884411 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:49.884850 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:49.885541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:49.885997 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:49.886463 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:49.918763 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:49.919250 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:49.919682 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:49.920123 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lazy-loading 'fault' on Instance uuid 53623c08-1cee-4d8d-b22a-ead2c54619cd {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:01:49.959725 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:49.967405 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e252a179-6741-499f-9a2c-f52124a19acb tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1303 microversion: 2.1 time: 0.095534 Sep 01 15:01:49.967954 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 218/429] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:49 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:50.656782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:50.657395 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:50.663923 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:50.664407 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:50.664846 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:50.665540 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:50.665996 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:50.666451 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:50.790987 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:50.799424 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:50.801128 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:50.802605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-1e82dbc1-c812-4b7f-8c21-f20024546f21 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.149682 Sep 01 15:01:50.803161 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 212/430] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:50 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:50.988133 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:50.988677 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:50.995519 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:50.995982 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:50.996415 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:50.997094 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:50.997555 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:50.997975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:51.027783 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:51.028257 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:51.028685 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:51.029119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lazy-loading 'fault' on Instance uuid 53623c08-1cee-4d8d-b22a-ead2c54619cd {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:01:51.068771 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:51.076960 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-07184e1d-db8f-49af-846e-83d027351288 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1303 microversion: 2.1 time: 0.092657 Sep 01 15:01:51.077521 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 219/431] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:50 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:51.825541 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:51.826152 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:51.832575 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:51.833059 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:51.833496 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:51.834190 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:51.834675 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:51.835605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:51.963454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:51.972175 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:51.973630 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:51.974832 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-47a569a3-0a70-40b8-97e9-901cacff770d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1808 microversion: 2.20 time: 0.153209 Sep 01 15:01:51.975388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 213/432] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:51 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:52.096951 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:52.097632 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:52.104691 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:52.105175 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:52.105607 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:52.106356 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:52.106810 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:52.107235 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:52.139588 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:52.140019 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:52.140499 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:52.140959 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lazy-loading 'fault' on Instance uuid 53623c08-1cee-4d8d-b22a-ead2c54619cd {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:01:52.184199 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '534901c491b64bbe8bdc59776e643a78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5a5ea6aa4b4736ae49915583626e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:52.192265 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-46c08c9e-ec3a-4d41-8d84-e44d2d6a5b4f tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 200 len: 1303 microversion: 2.1 time: 0.099080 Sep 01 15:01:52.192786 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 220/433] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:52 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:01:52.997352 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:52.997984 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:53.004382 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:53.004864 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:53.005298 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:53.005982 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:53.006466 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:53.006944 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:53.145450 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:53.154933 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:53.156449 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:01:53.157650 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4699d152-79fb-4308-b706-39b7918f1f3a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1795 microversion: 2.20 time: 0.164098 Sep 01 15:01:53.158189 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 214/434] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:01:52 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1795 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:01:53.213650 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:53.214205 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] [instance: 53623c08-1cee-4d8d-b22a-ead2c54619cd] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:53.220625 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:53.221115 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:53.221558 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:53.222296 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:53.222760 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:53.223192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:53.229543 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=100 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:01:53.239656 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] HTTP exception thrown: Instance 53623c08-1cee-4d8d-b22a-ead2c54619cd could not be found. Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Request method failure captured: Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd HTTP/1.1 Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMkUObmL21RWLOWS0elDaQzD6eSlDU5mACnELJWG0Y8bicDbZ4VqP1chCO8FoGkYICRi1RRKWYgKMb5aDOaTftleN4Hj70D7pP33g5V2FDplzh7VsdZJOjXzCUsm2xDdPmDwWiDxoaGpGycOuJrCWDSHtv2HIFHwYcvUHTN2vERHf94 Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: ba5a5ea6aa4b4736ae49915583626e18 Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-VolumesActionsTest-1134162667 Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:01:53.241267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba5a5ea6aa4b4736ae49915583626e18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba5a5ea6aa4b4736ae49915583626e18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba5a5ea6aa4b4736ae49915583626e18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba5a5ea6aa4b4736ae49915583626e18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-VolumesActionsTest-1134162667 Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: ba5a5ea6aa4b4736ae49915583626e18 Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-VolumesActionsTest-1134162667 Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-VolumesActionsTest-1134162667-project Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 534901c491b64bbe8bdc59776e643a78 Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-VolumesActionsTest-1134162667-project Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 53623c08-1cee-4d8d-b22a-ead2c54619cd could not be found. Sep 01 15:01:53.242891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '53623c08-1cee-4d8d-b22a-ead2c54619cd'} Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53623c08-1cee-4d8d-b22a-ead2c54619cd could not be found. Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:01:53.243711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53623c08-1cee-4d8d-b22a-ead2c54619cd could not be found. Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53623c08-1cee-4d8d-b22a-ead2c54619cd could not be found. Sep 01 15:01:53.244975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:01:53.246061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] Returning 404 to user: Instance 53623c08-1cee-4d8d-b22a-ead2c54619cd could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:01:53.246061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2f65c9ec-f53b-4b04-86d8-122650031988 tempest-VolumesActionsTest-1134162667 tempest-VolumesActionsTest-1134162667-project] 10.222.0.33 "GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd" status: 404 len: 111 microversion: 2.1 time: 0.033433 Sep 01 15:01:53.246061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 221/435] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:01:53 2022] GET /compute/v2.1/servers/53623c08-1cee-4d8d-b22a-ead2c54619cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:01:59.298067 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6db66937-c29a-409b-9028-ed8725eb1419 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:01:59.298985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6db66937-c29a-409b-9028-ed8725eb1419 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:01:59.310574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6db66937-c29a-409b-9028-ed8725eb1419 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:59.311236 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6db66937-c29a-409b-9028-ed8725eb1419 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:59.311935 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6db66937-c29a-409b-9028-ed8725eb1419 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:59.312853 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6db66937-c29a-409b-9028-ed8725eb1419 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:01:59.313511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6db66937-c29a-409b-9028-ed8725eb1419 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:01:59.314110 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6db66937-c29a-409b-9028-ed8725eb1419 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:01:59.499892 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.objects.instance [None req-6db66937-c29a-409b-9028-ed8725eb1419 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lazy-loading 'services' on Instance uuid ce44cdb3-951f-466c-bf47-efbaaa59257e {{(pid=120554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:01:59.676038 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6db66937-c29a-409b-9028-ed8725eb1419 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e/os-volume_attachments/6bb7b845-0da5-45d7-b519-de1910ea1828" status: 202 len: 0 microversion: 2.1 time: 0.383289 Sep 01 15:01:59.676867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 215/436] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:01:59 2022] DELETE /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e/os-volume_attachments/6bb7b845-0da5-45d7-b519-de1910ea1828 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:02:00.869856 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2460d17b-8b1c-4e51-9aeb-991b8cf9e587 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:00.870506 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2460d17b-8b1c-4e51-9aeb-991b8cf9e587 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:00.878399 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2460d17b-8b1c-4e51-9aeb-991b8cf9e587 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:00.878832 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2460d17b-8b1c-4e51-9aeb-991b8cf9e587 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:00.879290 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2460d17b-8b1c-4e51-9aeb-991b8cf9e587 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:00.880104 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2460d17b-8b1c-4e51-9aeb-991b8cf9e587 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:00.880625 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2460d17b-8b1c-4e51-9aeb-991b8cf9e587 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:00.881112 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2460d17b-8b1c-4e51-9aeb-991b8cf9e587 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:00.911516 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2460d17b-8b1c-4e51-9aeb-991b8cf9e587 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Going to try to terminate instance {{(pid=120553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:02:00.997279 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2460d17b-8b1c-4e51-9aeb-991b8cf9e587 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 204 len: 0 microversion: 2.1 time: 0.131874 Sep 01 15:02:01.001767 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 222/437] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:02:00 2022] DELETE /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:02:01.009828 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f39afcad-feaa-4d7a-b264-d95551045903 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:01.010839 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f39afcad-feaa-4d7a-b264-d95551045903 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:01.018143 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f39afcad-feaa-4d7a-b264-d95551045903 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:01.018685 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f39afcad-feaa-4d7a-b264-d95551045903 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:01.019123 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f39afcad-feaa-4d7a-b264-d95551045903 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:01.019823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f39afcad-feaa-4d7a-b264-d95551045903 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:01.020282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f39afcad-feaa-4d7a-b264-d95551045903 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:01.020719 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f39afcad-feaa-4d7a-b264-d95551045903 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:01.172883 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f39afcad-feaa-4d7a-b264-d95551045903 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:01.181603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f39afcad-feaa-4d7a-b264-d95551045903 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1513 microversion: 2.1 time: 0.177561 Sep 01 15:02:01.182798 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 216/438] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:01 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:02.204379 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8535a668-56bb-4d91-8835-91cf81e5d304 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:02.205119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8535a668-56bb-4d91-8835-91cf81e5d304 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:02.213241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8535a668-56bb-4d91-8835-91cf81e5d304 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:02.214168 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8535a668-56bb-4d91-8835-91cf81e5d304 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:02.214964 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8535a668-56bb-4d91-8835-91cf81e5d304 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:02.215912 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8535a668-56bb-4d91-8835-91cf81e5d304 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:02.216615 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8535a668-56bb-4d91-8835-91cf81e5d304 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:02.217281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8535a668-56bb-4d91-8835-91cf81e5d304 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:02.358842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8535a668-56bb-4d91-8835-91cf81e5d304 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:02.366843 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8535a668-56bb-4d91-8835-91cf81e5d304 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1513 microversion: 2.1 time: 0.167063 Sep 01 15:02:02.367610 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 223/439] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:02 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:03.388248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-89e4b739-eb72-4da9-b5f8-433a673fb1a1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:03.388905 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-89e4b739-eb72-4da9-b5f8-433a673fb1a1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:03.400782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e4b739-eb72-4da9-b5f8-433a673fb1a1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:03.401196 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e4b739-eb72-4da9-b5f8-433a673fb1a1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:03.401631 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e4b739-eb72-4da9-b5f8-433a673fb1a1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:03.402477 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e4b739-eb72-4da9-b5f8-433a673fb1a1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:03.402934 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e4b739-eb72-4da9-b5f8-433a673fb1a1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:03.403356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89e4b739-eb72-4da9-b5f8-433a673fb1a1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:03.695844 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-89e4b739-eb72-4da9-b5f8-433a673fb1a1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:03.704430 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-89e4b739-eb72-4da9-b5f8-433a673fb1a1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1513 microversion: 2.1 time: 0.320069 Sep 01 15:02:03.705422 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 217/440] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:03 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1513 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:04.040375 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-d3da9ce5-6622-43bf-8652-eabd63c0ff71 req-4987b323-3a40-459d-a882-a76b0a31a060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce44cdb3-951f-466c-bf47-efbaaa59257e", "name": "network-vif-deleted", "tag": "a05e07ae-628f-4d01-bd85-f82e3792d6eb"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:04.058939 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-d3da9ce5-6622-43bf-8652-eabd63c0ff71 req-4987b323-3a40-459d-a882-a76b0a31a060 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:04.059728 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-d3da9ce5-6622-43bf-8652-eabd63c0ff71 req-4987b323-3a40-459d-a882-a76b0a31a060 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:04.060170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-d3da9ce5-6622-43bf-8652-eabd63c0ff71 req-4987b323-3a40-459d-a882-a76b0a31a060 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:04.072001 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-d3da9ce5-6622-43bf-8652-eabd63c0ff71 req-4987b323-3a40-459d-a882-a76b0a31a060 service nova] Creating event network-vif-deleted:a05e07ae-628f-4d01-bd85-f82e3792d6eb for instance ce44cdb3-951f-466c-bf47-efbaaa59257e on hv-cinder-85505 Sep 01 15:02:04.077257 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-d3da9ce5-6622-43bf-8652-eabd63c0ff71 req-4987b323-3a40-459d-a882-a76b0a31a060 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041298 Sep 01 15:02:04.081301 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 224/441] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:02:04.727579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:04.729333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:04.736599 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:04.738658 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:04.739592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:04.740436 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:04.741802 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:04.742548 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:04.742981 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:04.795962 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:04.797130 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:04.797882 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:04.798761 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.objects.instance [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lazy-loading 'fault' on Instance uuid ce44cdb3-951f-466c-bf47-efbaaa59257e {{(pid=120554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:02:04.860946 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:04.877273 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-de719b4f-4ba1-4e49-8ffe-c742dc488ee0 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 200 len: 1307 microversion: 2.1 time: 0.154282 Sep 01 15:02:04.878344 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 218/442] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:04 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:05.905878 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:05.906769 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: ce44cdb3-951f-466c-bf47-efbaaa59257e] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:05.914890 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:05.915755 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:05.916196 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:05.916946 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:05.917491 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:05.917953 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:05.936001 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] HTTP exception thrown: Instance ce44cdb3-951f-466c-bf47-efbaaa59257e could not be found. Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Request method failure captured: Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e HTTP/1.1 Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMkmBdI7UMo1pCCOjFbYUS1VC2KfT47_drGtXzWBbbqKnU1VvPqN3CCCmC8qBuJD_0d7TKeTKDIINX8vcoIexRBrQBXDKvbuAx_77fSTUe7Vgb5xLQA3F7u5Q32AFcTI8gMewK0eUzHbuiB7I5w1aBmf70NTxw35ImtyWs5NLTMjLOg Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 53f5d57b243e421cbf8d929cafe9c860 Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-VolumesSnapshotTestJSON-420185671 Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:02:05.937821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53f5d57b243e421cbf8d929cafe9c860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53f5d57b243e421cbf8d929cafe9c860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53f5d57b243e421cbf8d929cafe9c860", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53f5d57b243e421cbf8d929cafe9c860"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-VolumesSnapshotTestJSON-420185671 Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 53f5d57b243e421cbf8d929cafe9c860 Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-420185671 Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-VolumesSnapshotTestJSON-420185671-project Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 74b4bf3f69204fc896c996bcaa9e087e Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-VolumesSnapshotTestJSON-420185671-project Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance ce44cdb3-951f-466c-bf47-efbaaa59257e could not be found. Sep 01 15:02:05.939434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': 'ce44cdb3-951f-466c-bf47-efbaaa59257e'} Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce44cdb3-951f-466c-bf47-efbaaa59257e could not be found. Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:02:05.945307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce44cdb3-951f-466c-bf47-efbaaa59257e could not be found. Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce44cdb3-951f-466c-bf47-efbaaa59257e could not be found. Sep 01 15:02:05.951748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:02:05.954442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Returning 404 to user: Instance ce44cdb3-951f-466c-bf47-efbaaa59257e could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:02:05.954442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cd30bc25-d950-4708-bbf1-33aa5808a8f3 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e" status: 404 len: 111 microversion: 2.1 time: 0.038848 Sep 01 15:02:05.954442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 225/443] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:05 2022] GET /compute/v2.1/servers/ce44cdb3-951f-466c-bf47-efbaaa59257e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:02:15.860367 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5c42dcf6-fb64-4752-a80a-687e019d45c7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:15.860895 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5c42dcf6-fb64-4752-a80a-687e019d45c7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:15.863294 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:15.863941 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:15.870090 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c42dcf6-fb64-4752-a80a-687e019d45c7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:15.870594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c42dcf6-fb64-4752-a80a-687e019d45c7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:15.871031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c42dcf6-fb64-4752-a80a-687e019d45c7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:15.871713 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c42dcf6-fb64-4752-a80a-687e019d45c7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:15.872166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c42dcf6-fb64-4752-a80a-687e019d45c7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:15.872587 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5c42dcf6-fb64-4752-a80a-687e019d45c7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:15.956412 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.objects.instance [None req-5c42dcf6-fb64-4752-a80a-687e019d45c7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lazy-loading 'services' on Instance uuid 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 {{(pid=120554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:02:16.026706 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5c42dcf6-fb64-4752-a80a-687e019d45c7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/os-volume_attachments/34d54732-ac09-4332-91d7-f535fe3a2003" status: 202 len: 0 microversion: 2.1 time: 0.169982 Sep 01 15:02:16.027291 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 219/444] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:02:15 2022] DELETE /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/os-volume_attachments/34d54732-ac09-4332-91d7-f535fe3a2003 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:02:17.054597 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-574846127", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "networks": [{"uuid": "6eb53885-f9c1-4edf-8b7a-302fe86a6fcc"}]}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:17.063698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:17.064351 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:17.111876 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.network.neutron [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] validate_networks() for [('6eb53885-f9c1-4edf-8b7a-302fe86a6fcc', None, None, None, None, None)] {{(pid=120553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:02:17.154892 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-53c8e418-ecc3-4d59-8167-6561bcd92e47 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:17.162908 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-53c8e418-ecc3-4d59-8167-6561bcd92e47 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:17.163402 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-53c8e418-ecc3-4d59-8167-6561bcd92e47 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:17.163848 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-53c8e418-ecc3-4d59-8167-6561bcd92e47 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:17.188257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-53c8e418-ecc3-4d59-8167-6561bcd92e47 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Going to try to stop instance {{(pid=120554) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 15:02:17.228952 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-53c8e418-ecc3-4d59-8167-6561bcd92e47 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "POST /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/action" status: 202 len: 0 microversion: 2.1 time: 0.079218 Sep 01 15:02:17.229566 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 220/445] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:02:17 2022] POST /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 15:02:17.237719 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-05115d6d-55be-4391-88b8-b8590891e6e9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:17.238591 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-05115d6d-55be-4391-88b8-b8590891e6e9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:17.245029 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-05115d6d-55be-4391-88b8-b8590891e6e9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:17.245523 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-05115d6d-55be-4391-88b8-b8590891e6e9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:17.245963 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-05115d6d-55be-4391-88b8-b8590891e6e9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:17.246690 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-05115d6d-55be-4391-88b8-b8590891e6e9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:17.247140 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-05115d6d-55be-4391-88b8-b8590891e6e9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:17.247566 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-05115d6d-55be-4391-88b8-b8590891e6e9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:17.379771 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-05115d6d-55be-4391-88b8-b8590891e6e9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:17.388122 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-05115d6d-55be-4391-88b8-b8590891e6e9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1679 microversion: 2.1 time: 0.154342 Sep 01 15:02:17.388682 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 221/446] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:17 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:17.487477 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Flavor limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:02:17.487895 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Image limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:02:17.488373 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Flavor pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:02:17.488817 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Image pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:02:17.489227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:02:17.499398 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:17.499894 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:17.500323 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:17.501044 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:17.501504 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:17.501931 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:17.518140 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Getting quotas for project 53f5d57b243e421cbf8d929cafe9c860. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:02:17.522054 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Getting quotas for user 74b4bf3f69204fc896c996bcaa9e087e and project 53f5d57b243e421cbf8d929cafe9c860. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:02:17.532770 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Going to run 1 instances... {{(pid=120553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:02:17.535047 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:02:17.579903 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-bc444a03-b16b-432d-99ad-c7836770ddea tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529694 Sep 01 15:02:17.580521 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 226/447] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:02:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:02:17.591230 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d5c78f16-9f2a-4c3e-b5e0-ef26cb89c7bc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:17.591980 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d5c78f16-9f2a-4c3e-b5e0-ef26cb89c7bc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:17.646800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d5c78f16-9f2a-4c3e-b5e0-ef26cb89c7bc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:17.654719 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d5c78f16-9f2a-4c3e-b5e0-ef26cb89c7bc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1218 microversion: 2.1 time: 0.066429 Sep 01 15:02:17.654719 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 222/448] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:17 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:18.409597 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-fcbd5844-0de2-42e1-ab66-db8b1e02d5b0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:18.410228 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-fcbd5844-0de2-42e1-ab66-db8b1e02d5b0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:18.416573 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fcbd5844-0de2-42e1-ab66-db8b1e02d5b0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:18.417198 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fcbd5844-0de2-42e1-ab66-db8b1e02d5b0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:18.417710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fcbd5844-0de2-42e1-ab66-db8b1e02d5b0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:18.418521 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fcbd5844-0de2-42e1-ab66-db8b1e02d5b0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:18.419058 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fcbd5844-0de2-42e1-ab66-db8b1e02d5b0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:18.419571 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fcbd5844-0de2-42e1-ab66-db8b1e02d5b0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:18.675316 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0e08154c-5d70-4f3f-8c29-81497820416d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:18.675929 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0e08154c-5d70-4f3f-8c29-81497820416d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:18.676095 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-fcbd5844-0de2-42e1-ab66-db8b1e02d5b0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:18.684103 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0e08154c-5d70-4f3f-8c29-81497820416d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:18.684815 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0e08154c-5d70-4f3f-8c29-81497820416d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:18.685428 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0e08154c-5d70-4f3f-8c29-81497820416d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:18.686302 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0e08154c-5d70-4f3f-8c29-81497820416d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:18.686445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-fcbd5844-0de2-42e1-ab66-db8b1e02d5b0 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1679 microversion: 2.1 time: 0.280965 Sep 01 15:02:18.687032 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0e08154c-5d70-4f3f-8c29-81497820416d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:18.687494 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 227/449] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:18 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1679 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:18.687770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0e08154c-5d70-4f3f-8c29-81497820416d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:18.756578 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0e08154c-5d70-4f3f-8c29-81497820416d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:18.765096 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0e08154c-5d70-4f3f-8c29-81497820416d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1270 microversion: 2.1 time: 0.093841 Sep 01 15:02:18.765674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 223/450] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:18 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:19.655247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cb74140b-c6d5-4544-972c-f9d45d890240 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e84390ab-9f50-4c59-a109-12cccaf74b61"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:19.657629 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-cb74140b-c6d5-4544-972c-f9d45d890240 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:19.667706 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb74140b-c6d5-4544-972c-f9d45d890240 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:19.668206 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb74140b-c6d5-4544-972c-f9d45d890240 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:19.670998 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb74140b-c6d5-4544-972c-f9d45d890240 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:19.671741 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb74140b-c6d5-4544-972c-f9d45d890240 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:19.672228 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb74140b-c6d5-4544-972c-f9d45d890240 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:19.672675 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cb74140b-c6d5-4544-972c-f9d45d890240 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:19.708831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b11ac079-a79b-4ae5-bc7c-b86a09d50e15 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:19.710027 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b11ac079-a79b-4ae5-bc7c-b86a09d50e15 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:19.717242 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11ac079-a79b-4ae5-bc7c-b86a09d50e15 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:19.717751 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11ac079-a79b-4ae5-bc7c-b86a09d50e15 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:19.718209 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11ac079-a79b-4ae5-bc7c-b86a09d50e15 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:19.718959 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11ac079-a79b-4ae5-bc7c-b86a09d50e15 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:19.719497 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11ac079-a79b-4ae5-bc7c-b86a09d50e15 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:19.720019 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b11ac079-a79b-4ae5-bc7c-b86a09d50e15 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:19.950830 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b11ac079-a79b-4ae5-bc7c-b86a09d50e15 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:19.960822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b11ac079-a79b-4ae5-bc7c-b86a09d50e15 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1679 microversion: 2.1 time: 0.256318 Sep 01 15:02:19.962890 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 224/451] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:19 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1679 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:19.969135 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-07624e90-2679-4670-bddb-8f8a4a85d496 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:19.970098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-07624e90-2679-4670-bddb-8f8a4a85d496 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:19.976470 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07624e90-2679-4670-bddb-8f8a4a85d496 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:19.976961 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07624e90-2679-4670-bddb-8f8a4a85d496 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:19.977520 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07624e90-2679-4670-bddb-8f8a4a85d496 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:19.978222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07624e90-2679-4670-bddb-8f8a4a85d496 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:19.978704 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07624e90-2679-4670-bddb-8f8a4a85d496 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:19.979165 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-07624e90-2679-4670-bddb-8f8a4a85d496 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:20.051379 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cb74140b-c6d5-4544-972c-f9d45d890240 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "POST /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400502 Sep 01 15:02:20.052294 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 228/452] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:02:19 2022] POST /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:02:20.193458 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-07624e90-2679-4670-bddb-8f8a4a85d496 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:20.210269 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-07624e90-2679-4670-bddb-8f8a4a85d496 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1318 microversion: 2.1 time: 0.245724 Sep 01 15:02:20.210982 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 225/453] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:19 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:20.553172 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-aa84d346-fe00-427d-94d4-25958e5df699 req-1f1ac043-925a-4789-9ede-b748e92cf143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e7d0e5-5c57-4ed2-b230-f8fb40968842", "tag": "eb3feb67-a40e-4252-8e4e-65a5a38bd5bf"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:20.564138 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-aa84d346-fe00-427d-94d4-25958e5df699 req-1f1ac043-925a-4789-9ede-b748e92cf143 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:20.564624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-aa84d346-fe00-427d-94d4-25958e5df699 req-1f1ac043-925a-4789-9ede-b748e92cf143 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:20.565193 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-aa84d346-fe00-427d-94d4-25958e5df699 req-1f1ac043-925a-4789-9ede-b748e92cf143 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:20.576864 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-aa84d346-fe00-427d-94d4-25958e5df699 req-1f1ac043-925a-4789-9ede-b748e92cf143 service nova] Creating event network-changed:eb3feb67-a40e-4252-8e4e-65a5a38bd5bf for instance 55e7d0e5-5c57-4ed2-b230-f8fb40968842 on hv-cinder-85505 Sep 01 15:02:20.581611 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-aa84d346-fe00-427d-94d4-25958e5df699 req-1f1ac043-925a-4789-9ede-b748e92cf143 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033454 Sep 01 15:02:20.582454 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 229/454] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:02:20.983677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-008ee218-ad72-4a0c-ad94-d77ac4ef95fa tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:20.984597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-008ee218-ad72-4a0c-ad94-d77ac4ef95fa tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:20.991542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-008ee218-ad72-4a0c-ad94-d77ac4ef95fa tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:20.992042 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-008ee218-ad72-4a0c-ad94-d77ac4ef95fa tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:20.992489 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-008ee218-ad72-4a0c-ad94-d77ac4ef95fa tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:20.993800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-008ee218-ad72-4a0c-ad94-d77ac4ef95fa tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:20.994452 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-008ee218-ad72-4a0c-ad94-d77ac4ef95fa tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:20.994897 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-008ee218-ad72-4a0c-ad94-d77ac4ef95fa tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:21.123602 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-008ee218-ad72-4a0c-ad94-d77ac4ef95fa tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:21.131416 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-008ee218-ad72-4a0c-ad94-d77ac4ef95fa tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1679 microversion: 2.1 time: 0.152520 Sep 01 15:02:21.131982 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 226/455] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:20 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:21.233138 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6d2362b6-6cd6-4f30-aa10-104d98da5215 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:21.233818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6d2362b6-6cd6-4f30-aa10-104d98da5215 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:21.239881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d2362b6-6cd6-4f30-aa10-104d98da5215 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:21.240369 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d2362b6-6cd6-4f30-aa10-104d98da5215 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:21.240817 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d2362b6-6cd6-4f30-aa10-104d98da5215 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:21.241503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d2362b6-6cd6-4f30-aa10-104d98da5215 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:21.241963 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d2362b6-6cd6-4f30-aa10-104d98da5215 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:21.242492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d2362b6-6cd6-4f30-aa10-104d98da5215 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:21.592454 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6d2362b6-6cd6-4f30-aa10-104d98da5215 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:21.600341 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6d2362b6-6cd6-4f30-aa10-104d98da5215 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1318 microversion: 2.1 time: 0.371816 Sep 01 15:02:21.600970 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 230/456] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:21 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:22.154137 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b7227b5e-bdf5-4fa7-b234-6aaede921978 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:22.154814 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b7227b5e-bdf5-4fa7-b234-6aaede921978 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:22.161513 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7227b5e-bdf5-4fa7-b234-6aaede921978 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:22.162007 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7227b5e-bdf5-4fa7-b234-6aaede921978 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:22.162483 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7227b5e-bdf5-4fa7-b234-6aaede921978 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:22.163298 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7227b5e-bdf5-4fa7-b234-6aaede921978 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:22.163766 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7227b5e-bdf5-4fa7-b234-6aaede921978 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:22.164702 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7227b5e-bdf5-4fa7-b234-6aaede921978 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:22.391451 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b7227b5e-bdf5-4fa7-b234-6aaede921978 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:22.399524 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b7227b5e-bdf5-4fa7-b234-6aaede921978 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1679 microversion: 2.1 time: 0.249909 Sep 01 15:02:22.409128 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 227/457] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:22 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:22.620188 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-16565e67-8f38-40ed-a2a3-c872102d20d2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:22.620741 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-16565e67-8f38-40ed-a2a3-c872102d20d2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:22.627075 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16565e67-8f38-40ed-a2a3-c872102d20d2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:22.627558 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16565e67-8f38-40ed-a2a3-c872102d20d2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:22.627999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16565e67-8f38-40ed-a2a3-c872102d20d2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:22.628684 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16565e67-8f38-40ed-a2a3-c872102d20d2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:22.629146 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16565e67-8f38-40ed-a2a3-c872102d20d2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:22.629576 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16565e67-8f38-40ed-a2a3-c872102d20d2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:22.755157 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-16565e67-8f38-40ed-a2a3-c872102d20d2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:22.763307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-16565e67-8f38-40ed-a2a3-c872102d20d2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1318 microversion: 2.1 time: 0.147082 Sep 01 15:02:22.763859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 231/458] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:22 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:23.420059 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-8b3aca3b-252f-44ed-b703-aaa2a42d263b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:23.420608 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-8b3aca3b-252f-44ed-b703-aaa2a42d263b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:23.427300 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b3aca3b-252f-44ed-b703-aaa2a42d263b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:23.427787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b3aca3b-252f-44ed-b703-aaa2a42d263b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:23.428234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b3aca3b-252f-44ed-b703-aaa2a42d263b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:23.428922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b3aca3b-252f-44ed-b703-aaa2a42d263b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:23.429377 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b3aca3b-252f-44ed-b703-aaa2a42d263b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:23.430472 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b3aca3b-252f-44ed-b703-aaa2a42d263b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:23.559615 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-8b3aca3b-252f-44ed-b703-aaa2a42d263b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:23.567558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-8b3aca3b-252f-44ed-b703-aaa2a42d263b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1679 microversion: 2.1 time: 0.151370 Sep 01 15:02:23.568124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 228/459] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:23 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:23.783546 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-35aaeea4-0dc1-4b30-8752-5eaf3b670542 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:23.784068 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-35aaeea4-0dc1-4b30-8752-5eaf3b670542 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:23.791068 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35aaeea4-0dc1-4b30-8752-5eaf3b670542 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:23.791552 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35aaeea4-0dc1-4b30-8752-5eaf3b670542 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:23.791989 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35aaeea4-0dc1-4b30-8752-5eaf3b670542 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:23.792674 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35aaeea4-0dc1-4b30-8752-5eaf3b670542 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:23.793134 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35aaeea4-0dc1-4b30-8752-5eaf3b670542 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:23.793561 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35aaeea4-0dc1-4b30-8752-5eaf3b670542 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:23.923599 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-35aaeea4-0dc1-4b30-8752-5eaf3b670542 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:23.931545 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-35aaeea4-0dc1-4b30-8752-5eaf3b670542 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1318 microversion: 2.1 time: 0.151984 Sep 01 15:02:23.932098 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 232/460] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:23 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:24.589217 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-73f07c66-ba9c-4930-bdc9-9b5704e98bfb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:24.589831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-73f07c66-ba9c-4930-bdc9-9b5704e98bfb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:24.599414 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73f07c66-ba9c-4930-bdc9-9b5704e98bfb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:24.599955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73f07c66-ba9c-4930-bdc9-9b5704e98bfb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:24.600468 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73f07c66-ba9c-4930-bdc9-9b5704e98bfb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:24.601345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73f07c66-ba9c-4930-bdc9-9b5704e98bfb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:24.601840 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73f07c66-ba9c-4930-bdc9-9b5704e98bfb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:24.602289 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73f07c66-ba9c-4930-bdc9-9b5704e98bfb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:24.750788 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-73f07c66-ba9c-4930-bdc9-9b5704e98bfb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:24.759189 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-73f07c66-ba9c-4930-bdc9-9b5704e98bfb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1679 microversion: 2.1 time: 0.174613 Sep 01 15:02:24.759742 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 229/461] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:24 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:24.953208 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6ce46e92-7d4a-41f1-b271-130ba4cf1743 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:24.953863 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6ce46e92-7d4a-41f1-b271-130ba4cf1743 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:24.960378 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ce46e92-7d4a-41f1-b271-130ba4cf1743 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:24.960874 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ce46e92-7d4a-41f1-b271-130ba4cf1743 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:24.961321 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ce46e92-7d4a-41f1-b271-130ba4cf1743 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:24.962025 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ce46e92-7d4a-41f1-b271-130ba4cf1743 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:24.964600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ce46e92-7d4a-41f1-b271-130ba4cf1743 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:24.965292 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6ce46e92-7d4a-41f1-b271-130ba4cf1743 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:25.099570 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6ce46e92-7d4a-41f1-b271-130ba4cf1743 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:25.107737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6ce46e92-7d4a-41f1-b271-130ba4cf1743 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1318 microversion: 2.1 time: 0.159587 Sep 01 15:02:25.108285 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 233/462] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:24 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:25.780153 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4da42248-a6bc-4ebc-a5a0-26ca3ed41172 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:25.780797 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4da42248-a6bc-4ebc-a5a0-26ca3ed41172 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:25.787006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4da42248-a6bc-4ebc-a5a0-26ca3ed41172 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:25.787491 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4da42248-a6bc-4ebc-a5a0-26ca3ed41172 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:25.787969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4da42248-a6bc-4ebc-a5a0-26ca3ed41172 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:25.788601 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4da42248-a6bc-4ebc-a5a0-26ca3ed41172 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:25.789106 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4da42248-a6bc-4ebc-a5a0-26ca3ed41172 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:25.789525 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4da42248-a6bc-4ebc-a5a0-26ca3ed41172 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:25.916316 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4da42248-a6bc-4ebc-a5a0-26ca3ed41172 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:25.924883 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4da42248-a6bc-4ebc-a5a0-26ca3ed41172 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1679 microversion: 2.1 time: 0.148356 Sep 01 15:02:25.925466 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 230/463] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:25 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:26.129015 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-54915e46-1d1d-4e30-b230-c6dc96652797 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:26.129662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-54915e46-1d1d-4e30-b230-c6dc96652797 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:26.137277 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54915e46-1d1d-4e30-b230-c6dc96652797 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:26.137779 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54915e46-1d1d-4e30-b230-c6dc96652797 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:26.138249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54915e46-1d1d-4e30-b230-c6dc96652797 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:26.138986 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54915e46-1d1d-4e30-b230-c6dc96652797 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:26.139455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54915e46-1d1d-4e30-b230-c6dc96652797 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:26.139892 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-54915e46-1d1d-4e30-b230-c6dc96652797 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:26.283631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-54915e46-1d1d-4e30-b230-c6dc96652797 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:26.291612 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-54915e46-1d1d-4e30-b230-c6dc96652797 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1318 microversion: 2.1 time: 0.166512 Sep 01 15:02:26.292299 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 234/464] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:26 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:26.663525 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-d650a8e3-bb14-4a91-b600-f85625182d59 req-02062374-5300-40ef-b165-6bb7782797d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e7d0e5-5c57-4ed2-b230-f8fb40968842", "name": "network-vif-plugged", "status": "completed", "tag": "eb3feb67-a40e-4252-8e4e-65a5a38bd5bf"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:26.676998 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-d650a8e3-bb14-4a91-b600-f85625182d59 req-02062374-5300-40ef-b165-6bb7782797d1 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:26.677777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-d650a8e3-bb14-4a91-b600-f85625182d59 req-02062374-5300-40ef-b165-6bb7782797d1 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:26.678459 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-d650a8e3-bb14-4a91-b600-f85625182d59 req-02062374-5300-40ef-b165-6bb7782797d1 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:26.696564 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-d650a8e3-bb14-4a91-b600-f85625182d59 req-02062374-5300-40ef-b165-6bb7782797d1 service nova] Creating event network-vif-plugged:eb3feb67-a40e-4252-8e4e-65a5a38bd5bf for instance 55e7d0e5-5c57-4ed2-b230-f8fb40968842 on hv-cinder-85505 Sep 01 15:02:26.702087 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-d650a8e3-bb14-4a91-b600-f85625182d59 req-02062374-5300-40ef-b165-6bb7782797d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048135 Sep 01 15:02:26.703813 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 231/465] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:02:26.947031 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2afcbeda-cb03-49d2-8e77-0f0d030bc89c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:26.947651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2afcbeda-cb03-49d2-8e77-0f0d030bc89c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:26.953629 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2afcbeda-cb03-49d2-8e77-0f0d030bc89c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:26.954120 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2afcbeda-cb03-49d2-8e77-0f0d030bc89c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:26.954609 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2afcbeda-cb03-49d2-8e77-0f0d030bc89c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:26.955303 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2afcbeda-cb03-49d2-8e77-0f0d030bc89c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:26.955763 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2afcbeda-cb03-49d2-8e77-0f0d030bc89c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:26.956198 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2afcbeda-cb03-49d2-8e77-0f0d030bc89c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:27.086930 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2afcbeda-cb03-49d2-8e77-0f0d030bc89c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:27.094725 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2afcbeda-cb03-49d2-8e77-0f0d030bc89c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1679 microversion: 2.1 time: 0.151577 Sep 01 15:02:27.095278 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 235/466] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:26 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:27.313100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1ffc6937-a726-42f6-b688-602abd9f8b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:27.313800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-1ffc6937-a726-42f6-b688-602abd9f8b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:27.320450 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1ffc6937-a726-42f6-b688-602abd9f8b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:27.320937 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1ffc6937-a726-42f6-b688-602abd9f8b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:27.321375 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1ffc6937-a726-42f6-b688-602abd9f8b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:27.322065 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1ffc6937-a726-42f6-b688-602abd9f8b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:27.322558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1ffc6937-a726-42f6-b688-602abd9f8b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:27.322989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1ffc6937-a726-42f6-b688-602abd9f8b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:27.453139 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1ffc6937-a726-42f6-b688-602abd9f8b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:27.460712 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-1ffc6937-a726-42f6-b688-602abd9f8b32 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1318 microversion: 2.1 time: 0.151830 Sep 01 15:02:27.461309 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 232/467] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:27 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:27.584714 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d3da0159-6e74-4e0c-8aa0-e44d08c9273e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:27.587506 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d3da0159-6e74-4e0c-8aa0-e44d08c9273e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:27.589876 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:27.590756 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=6 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:27.596193 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3da0159-6e74-4e0c-8aa0-e44d08c9273e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:27.596673 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3da0159-6e74-4e0c-8aa0-e44d08c9273e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:27.597107 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3da0159-6e74-4e0c-8aa0-e44d08c9273e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:27.597867 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3da0159-6e74-4e0c-8aa0-e44d08c9273e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:27.598350 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3da0159-6e74-4e0c-8aa0-e44d08c9273e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:27.598778 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d3da0159-6e74-4e0c-8aa0-e44d08c9273e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:27.621493 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-d3da0159-6e74-4e0c-8aa0-e44d08c9273e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lazy-loading 'flavor' on Instance uuid da903e65-d948-457a-8d12-9253ffeacb02 {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:02:27.754746 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d3da0159-6e74-4e0c-8aa0-e44d08c9273e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "POST /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/action" status: 200 len: 32 microversion: 2.1 time: 0.173817 Sep 01 15:02:27.755558 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 236/468] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:02:27 2022] POST /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 15:02:27.765328 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-36c1dc73-158f-4b62-9833-fb0308309b63 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:27.766047 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-36c1dc73-158f-4b62-9833-fb0308309b63 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:27.768518 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:27.775583 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-36c1dc73-158f-4b62-9833-fb0308309b63 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:27.776076 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-36c1dc73-158f-4b62-9833-fb0308309b63 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:27.776577 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-36c1dc73-158f-4b62-9833-fb0308309b63 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:27.777509 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-36c1dc73-158f-4b62-9833-fb0308309b63 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:27.778135 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-36c1dc73-158f-4b62-9833-fb0308309b63 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:27.778891 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-36c1dc73-158f-4b62-9833-fb0308309b63 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:27.953230 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-36c1dc73-158f-4b62-9833-fb0308309b63 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:27.962056 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-36c1dc73-158f-4b62-9833-fb0308309b63 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.200739 Sep 01 15:02:27.962644 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 233/469] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:27 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:28.117240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-41de8511-a80d-45e6-b03e-b6d3937c23cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:28.117998 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-41de8511-a80d-45e6-b03e-b6d3937c23cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:28.127957 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-41de8511-a80d-45e6-b03e-b6d3937c23cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:28.128840 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-41de8511-a80d-45e6-b03e-b6d3937c23cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:28.129613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-41de8511-a80d-45e6-b03e-b6d3937c23cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:28.130576 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-41de8511-a80d-45e6-b03e-b6d3937c23cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:28.131224 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-41de8511-a80d-45e6-b03e-b6d3937c23cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:28.131658 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-41de8511-a80d-45e6-b03e-b6d3937c23cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:28.279510 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-41de8511-a80d-45e6-b03e-b6d3937c23cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:28.287861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-41de8511-a80d-45e6-b03e-b6d3937c23cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1656 microversion: 2.1 time: 0.174973 Sep 01 15:02:28.288439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 237/470] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:28 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1656 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:28.312778 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2ef53872-6315-4a66-a5a5-509c38d87b3c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:28.321386 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2ef53872-6315-4a66-a5a5-509c38d87b3c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:28.322407 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2ef53872-6315-4a66-a5a5-509c38d87b3c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:28.322598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2ef53872-6315-4a66-a5a5-509c38d87b3c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:28.346005 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2ef53872-6315-4a66-a5a5-509c38d87b3c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Going to try to start instance {{(pid=120554) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 15:02:28.370979 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:28.391637 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2ef53872-6315-4a66-a5a5-509c38d87b3c tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "POST /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/action" status: 202 len: 0 microversion: 2.1 time: 0.082652 Sep 01 15:02:28.392251 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 234/471] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:02:28 2022] POST /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:02:28.401496 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e62e4b3f-ab27-4cc8-91d4-67b03807b57d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:28.402366 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e62e4b3f-ab27-4cc8-91d4-67b03807b57d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:28.409155 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e62e4b3f-ab27-4cc8-91d4-67b03807b57d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:28.409651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e62e4b3f-ab27-4cc8-91d4-67b03807b57d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:28.410134 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e62e4b3f-ab27-4cc8-91d4-67b03807b57d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:28.410867 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e62e4b3f-ab27-4cc8-91d4-67b03807b57d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:28.411327 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e62e4b3f-ab27-4cc8-91d4-67b03807b57d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:28.411755 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e62e4b3f-ab27-4cc8-91d4-67b03807b57d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:28.483487 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6a317d36-f3fb-4e7e-b7f0-0f6b54f1e01c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:28.484492 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6a317d36-f3fb-4e7e-b7f0-0f6b54f1e01c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:28.492975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a317d36-f3fb-4e7e-b7f0-0f6b54f1e01c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:28.493926 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a317d36-f3fb-4e7e-b7f0-0f6b54f1e01c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:28.494871 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a317d36-f3fb-4e7e-b7f0-0f6b54f1e01c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:28.496144 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a317d36-f3fb-4e7e-b7f0-0f6b54f1e01c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:28.496990 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a317d36-f3fb-4e7e-b7f0-0f6b54f1e01c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:28.497692 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a317d36-f3fb-4e7e-b7f0-0f6b54f1e01c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:28.577568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e62e4b3f-ab27-4cc8-91d4-67b03807b57d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:28.593719 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e62e4b3f-ab27-4cc8-91d4-67b03807b57d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1665 microversion: 2.1 time: 0.197261 Sep 01 15:02:28.595808 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 238/472] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:28 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1665 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:28.734486 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6a317d36-f3fb-4e7e-b7f0-0f6b54f1e01c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:28.742663 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6a317d36-f3fb-4e7e-b7f0-0f6b54f1e01c tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1318 microversion: 2.1 time: 0.265023 Sep 01 15:02:28.743238 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 235/473] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:28 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:28.983591 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ca02ebf7-0327-44e6-9b9a-987a18d0dcb6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:28.984209 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ca02ebf7-0327-44e6-9b9a-987a18d0dcb6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:28.990475 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca02ebf7-0327-44e6-9b9a-987a18d0dcb6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:28.990972 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca02ebf7-0327-44e6-9b9a-987a18d0dcb6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:28.991411 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca02ebf7-0327-44e6-9b9a-987a18d0dcb6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:28.992160 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca02ebf7-0327-44e6-9b9a-987a18d0dcb6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:28.993111 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca02ebf7-0327-44e6-9b9a-987a18d0dcb6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:28.993540 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca02ebf7-0327-44e6-9b9a-987a18d0dcb6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:29.202085 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ca02ebf7-0327-44e6-9b9a-987a18d0dcb6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:29.211571 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ca02ebf7-0327-44e6-9b9a-987a18d0dcb6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.231245 Sep 01 15:02:29.212111 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 239/474] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:28 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:29.615761 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-97b5f5d2-c40d-4fa3-b67e-fe7c5d52b413 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:29.616365 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-97b5f5d2-c40d-4fa3-b67e-fe7c5d52b413 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:29.622817 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-97b5f5d2-c40d-4fa3-b67e-fe7c5d52b413 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:29.623306 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-97b5f5d2-c40d-4fa3-b67e-fe7c5d52b413 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:29.623741 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-97b5f5d2-c40d-4fa3-b67e-fe7c5d52b413 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:29.624436 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-97b5f5d2-c40d-4fa3-b67e-fe7c5d52b413 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:29.624890 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-97b5f5d2-c40d-4fa3-b67e-fe7c5d52b413 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:29.625316 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-97b5f5d2-c40d-4fa3-b67e-fe7c5d52b413 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:29.753335 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-97b5f5d2-c40d-4fa3-b67e-fe7c5d52b413 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:29.761770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-97b5f5d2-c40d-4fa3-b67e-fe7c5d52b413 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1665 microversion: 2.1 time: 0.149837 Sep 01 15:02:29.762419 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 236/475] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:29 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:29.763357 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-731cd451-7a65-4648-ac69-0bcdb5b1f04e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:29.763986 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-731cd451-7a65-4648-ac69-0bcdb5b1f04e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:29.770580 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-731cd451-7a65-4648-ac69-0bcdb5b1f04e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:29.771279 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-731cd451-7a65-4648-ac69-0bcdb5b1f04e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:29.771719 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-731cd451-7a65-4648-ac69-0bcdb5b1f04e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:29.772417 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-731cd451-7a65-4648-ac69-0bcdb5b1f04e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:29.772903 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-731cd451-7a65-4648-ac69-0bcdb5b1f04e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:29.773923 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-731cd451-7a65-4648-ac69-0bcdb5b1f04e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:29.791836 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:29.905519 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-731cd451-7a65-4648-ac69-0bcdb5b1f04e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:29.913342 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-731cd451-7a65-4648-ac69-0bcdb5b1f04e tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1507 microversion: 2.1 time: 0.153925 Sep 01 15:02:29.913904 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 240/476] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:29 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:29.934088 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4004550c-88c6-42cb-be83-2813d6643a2d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10951530-1a79-4f64-abdc-530bf08b475c", "device": "/dev/sdb"}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:29.937071 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4004550c-88c6-42cb-be83-2813d6643a2d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:29.943023 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4004550c-88c6-42cb-be83-2813d6643a2d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:29.943504 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4004550c-88c6-42cb-be83-2813d6643a2d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:29.943935 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4004550c-88c6-42cb-be83-2813d6643a2d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:29.944624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4004550c-88c6-42cb-be83-2813d6643a2d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:29.945071 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4004550c-88c6-42cb-be83-2813d6643a2d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:29.946109 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4004550c-88c6-42cb-be83-2813d6643a2d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:30.232882 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9fefe267-bab8-4af8-9065-981aeb7df173 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:30.233613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9fefe267-bab8-4af8-9065-981aeb7df173 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:30.239524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fefe267-bab8-4af8-9065-981aeb7df173 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:30.240013 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fefe267-bab8-4af8-9065-981aeb7df173 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:30.240454 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fefe267-bab8-4af8-9065-981aeb7df173 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:30.241139 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fefe267-bab8-4af8-9065-981aeb7df173 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:30.241597 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fefe267-bab8-4af8-9065-981aeb7df173 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:30.242025 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fefe267-bab8-4af8-9065-981aeb7df173 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:30.347443 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4004550c-88c6-42cb-be83-2813d6643a2d tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "POST /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417655 Sep 01 15:02:30.348451 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 237/477] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:02:29 2022] POST /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:02:30.397450 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9fefe267-bab8-4af8-9065-981aeb7df173 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:30.408341 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9fefe267-bab8-4af8-9065-981aeb7df173 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.179140 Sep 01 15:02:30.410488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 241/478] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:30 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:30.784957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ba3ca7e7-dcfe-4960-a0e5-8b8f73fe2825 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:30.785661 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ba3ca7e7-dcfe-4960-a0e5-8b8f73fe2825 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:30.792833 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba3ca7e7-dcfe-4960-a0e5-8b8f73fe2825 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:30.793366 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba3ca7e7-dcfe-4960-a0e5-8b8f73fe2825 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:30.794084 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba3ca7e7-dcfe-4960-a0e5-8b8f73fe2825 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:30.794601 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba3ca7e7-dcfe-4960-a0e5-8b8f73fe2825 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:30.795066 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba3ca7e7-dcfe-4960-a0e5-8b8f73fe2825 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:30.795639 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba3ca7e7-dcfe-4960-a0e5-8b8f73fe2825 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:31.001046 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ba3ca7e7-dcfe-4960-a0e5-8b8f73fe2825 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:31.009601 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ba3ca7e7-dcfe-4960-a0e5-8b8f73fe2825 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1669 microversion: 2.1 time: 0.229701 Sep 01 15:02:31.011480 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 238/479] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:30 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1669 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:31.430477 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-91b09ed9-657d-418f-bc8f-31c9404e4c54 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:31.431153 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-91b09ed9-657d-418f-bc8f-31c9404e4c54 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:31.437932 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-91b09ed9-657d-418f-bc8f-31c9404e4c54 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:31.438583 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-91b09ed9-657d-418f-bc8f-31c9404e4c54 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:31.439258 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-91b09ed9-657d-418f-bc8f-31c9404e4c54 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:31.440181 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-91b09ed9-657d-418f-bc8f-31c9404e4c54 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:31.440839 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-91b09ed9-657d-418f-bc8f-31c9404e4c54 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:31.441551 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-91b09ed9-657d-418f-bc8f-31c9404e4c54 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:31.575475 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-91b09ed9-657d-418f-bc8f-31c9404e4c54 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:31.583954 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-91b09ed9-657d-418f-bc8f-31c9404e4c54 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.158131 Sep 01 15:02:31.584697 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 242/480] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:31 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:32.607981 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f9c1351e-53fc-4037-88f3-4ac397ab9085 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:32.609085 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f9c1351e-53fc-4037-88f3-4ac397ab9085 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:32.618073 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f9c1351e-53fc-4037-88f3-4ac397ab9085 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:32.619177 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f9c1351e-53fc-4037-88f3-4ac397ab9085 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:32.619746 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f9c1351e-53fc-4037-88f3-4ac397ab9085 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:32.620569 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f9c1351e-53fc-4037-88f3-4ac397ab9085 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:32.621132 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f9c1351e-53fc-4037-88f3-4ac397ab9085 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:32.621658 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f9c1351e-53fc-4037-88f3-4ac397ab9085 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:33.096117 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f9c1351e-53fc-4037-88f3-4ac397ab9085 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:33.106132 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f9c1351e-53fc-4037-88f3-4ac397ab9085 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.504478 Sep 01 15:02:33.106959 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 239/481] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:32 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:34.129052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d7666760-24e0-461c-8959-a3d6dbf09681 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:34.135790 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d7666760-24e0-461c-8959-a3d6dbf09681 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:34.149275 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d7666760-24e0-461c-8959-a3d6dbf09681 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:34.150308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d7666760-24e0-461c-8959-a3d6dbf09681 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:34.151015 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d7666760-24e0-461c-8959-a3d6dbf09681 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:34.152108 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d7666760-24e0-461c-8959-a3d6dbf09681 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:34.153045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d7666760-24e0-461c-8959-a3d6dbf09681 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:34.153658 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d7666760-24e0-461c-8959-a3d6dbf09681 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:34.470216 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d7666760-24e0-461c-8959-a3d6dbf09681 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:34.479640 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d7666760-24e0-461c-8959-a3d6dbf09681 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.355428 Sep 01 15:02:34.488230 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 243/482] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:34 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:34.521207 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4a2b6975-5f4a-4bfe-8f9e-c11e524bcbc8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:34.522370 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4a2b6975-5f4a-4bfe-8f9e-c11e524bcbc8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:34.529648 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4a2b6975-5f4a-4bfe-8f9e-c11e524bcbc8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:34.530016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4a2b6975-5f4a-4bfe-8f9e-c11e524bcbc8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:34.530482 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4a2b6975-5f4a-4bfe-8f9e-c11e524bcbc8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:34.531316 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4a2b6975-5f4a-4bfe-8f9e-c11e524bcbc8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:34.531763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4a2b6975-5f4a-4bfe-8f9e-c11e524bcbc8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:34.532188 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4a2b6975-5f4a-4bfe-8f9e-c11e524bcbc8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:34.562719 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4a2b6975-5f4a-4bfe-8f9e-c11e524bcbc8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments/dd83018b-46e8-4101-97cb-4d3c4118aedc" status: 200 len: 194 microversion: 2.20 time: 0.045786 Sep 01 15:02:34.563540 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 240/483] 10.222.0.33 () {60 vars in 1454 bytes} [Thu Sep 1 15:02:34 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments/dd83018b-46e8-4101-97cb-4d3c4118aedc => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 15:02:34.662960 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f132feee-1608-44d1-8783-ff26eb42d19f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:34.663605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f132feee-1608-44d1-8783-ff26eb42d19f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:34.673030 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f132feee-1608-44d1-8783-ff26eb42d19f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:34.673676 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f132feee-1608-44d1-8783-ff26eb42d19f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:34.674416 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f132feee-1608-44d1-8783-ff26eb42d19f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:34.675135 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f132feee-1608-44d1-8783-ff26eb42d19f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:34.675595 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f132feee-1608-44d1-8783-ff26eb42d19f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:34.676376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f132feee-1608-44d1-8783-ff26eb42d19f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:34.811185 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-f132feee-1608-44d1-8783-ff26eb42d19f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lazy-loading 'services' on Instance uuid 2570eed9-40bd-40ef-92d6-63b4e3cc83bf {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:02:34.931853 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f132feee-1608-44d1-8783-ff26eb42d19f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments/dd83018b-46e8-4101-97cb-4d3c4118aedc" status: 202 len: 0 microversion: 2.20 time: 0.285056 Sep 01 15:02:34.932688 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 244/484] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Sep 1 15:02:34 2022] DELETE /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments/dd83018b-46e8-4101-97cb-4d3c4118aedc => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:02:34.941021 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4243b9c9-a501-41c7-9d07-696969b7b686 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:34.943922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4243b9c9-a501-41c7-9d07-696969b7b686 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:34.952231 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4243b9c9-a501-41c7-9d07-696969b7b686 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:34.953187 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4243b9c9-a501-41c7-9d07-696969b7b686 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:34.953969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4243b9c9-a501-41c7-9d07-696969b7b686 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:34.955046 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4243b9c9-a501-41c7-9d07-696969b7b686 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:34.956684 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4243b9c9-a501-41c7-9d07-696969b7b686 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:34.957480 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4243b9c9-a501-41c7-9d07-696969b7b686 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:35.002574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4243b9c9-a501-41c7-9d07-696969b7b686 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065642 Sep 01 15:02:35.003283 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 241/485] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 1 15:02:34 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 15:02:35.503692 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5f93bc26-fa8c-4256-98f8-c0010d6341d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:35.505528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5f93bc26-fa8c-4256-98f8-c0010d6341d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:35.512848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f93bc26-fa8c-4256-98f8-c0010d6341d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:35.513405 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f93bc26-fa8c-4256-98f8-c0010d6341d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:35.514168 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f93bc26-fa8c-4256-98f8-c0010d6341d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:35.515101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f93bc26-fa8c-4256-98f8-c0010d6341d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:35.515893 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f93bc26-fa8c-4256-98f8-c0010d6341d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:35.516507 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f93bc26-fa8c-4256-98f8-c0010d6341d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:35.755279 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-5f93bc26-fa8c-4256-98f8-c0010d6341d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:35.767063 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5f93bc26-fa8c-4256-98f8-c0010d6341d9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.268323 Sep 01 15:02:35.767642 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 245/486] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:35 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:36.016899 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2689f40f-7a7a-498c-9934-2ce2535026c5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:36.019116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2689f40f-7a7a-498c-9934-2ce2535026c5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:36.026855 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2689f40f-7a7a-498c-9934-2ce2535026c5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:36.027619 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2689f40f-7a7a-498c-9934-2ce2535026c5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:36.028074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2689f40f-7a7a-498c-9934-2ce2535026c5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:36.028775 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2689f40f-7a7a-498c-9934-2ce2535026c5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:36.029233 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2689f40f-7a7a-498c-9934-2ce2535026c5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:36.029662 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2689f40f-7a7a-498c-9934-2ce2535026c5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:36.062937 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2689f40f-7a7a-498c-9934-2ce2535026c5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051438 Sep 01 15:02:36.063540 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 242/487] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 1 15:02:36 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 15:02:36.789723 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5f182d07-6794-41a6-8bad-dac71c9ca7ce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:36.790635 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5f182d07-6794-41a6-8bad-dac71c9ca7ce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:36.797406 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f182d07-6794-41a6-8bad-dac71c9ca7ce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:36.798080 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f182d07-6794-41a6-8bad-dac71c9ca7ce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:36.798822 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f182d07-6794-41a6-8bad-dac71c9ca7ce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:36.799784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f182d07-6794-41a6-8bad-dac71c9ca7ce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:36.800278 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f182d07-6794-41a6-8bad-dac71c9ca7ce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:36.800817 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f182d07-6794-41a6-8bad-dac71c9ca7ce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:37.056216 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-5f182d07-6794-41a6-8bad-dac71c9ca7ce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:37.079254 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1a3e84ad-5537-407f-8c22-d8cd42a0cebb tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:37.082388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-1a3e84ad-5537-407f-8c22-d8cd42a0cebb tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:37.086502 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5f182d07-6794-41a6-8bad-dac71c9ca7ce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.301093 Sep 01 15:02:37.088364 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 246/488] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:36 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:37.103276 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e84ad-5537-407f-8c22-d8cd42a0cebb tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:37.104138 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e84ad-5537-407f-8c22-d8cd42a0cebb tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:37.105931 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e84ad-5537-407f-8c22-d8cd42a0cebb tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:37.107356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e84ad-5537-407f-8c22-d8cd42a0cebb tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:37.107948 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e84ad-5537-407f-8c22-d8cd42a0cebb tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:37.108989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1a3e84ad-5537-407f-8c22-d8cd42a0cebb tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:37.144928 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-1a3e84ad-5537-407f-8c22-d8cd42a0cebb tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071606 Sep 01 15:02:37.145618 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 243/489] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 1 15:02:37 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 15:02:38.116415 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-667460b4-753e-4ee0-bbda-de9293bf9680 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:38.119144 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-667460b4-753e-4ee0-bbda-de9293bf9680 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:38.141303 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-667460b4-753e-4ee0-bbda-de9293bf9680 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:38.142408 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-667460b4-753e-4ee0-bbda-de9293bf9680 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:38.143662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-667460b4-753e-4ee0-bbda-de9293bf9680 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:38.144992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-667460b4-753e-4ee0-bbda-de9293bf9680 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:38.145885 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-667460b4-753e-4ee0-bbda-de9293bf9680 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:38.146788 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-667460b4-753e-4ee0-bbda-de9293bf9680 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:38.159913 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-8b8ce0c1-8262-48e1-96cb-446442d210a4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:38.166088 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-8b8ce0c1-8262-48e1-96cb-446442d210a4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:38.191280 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b8ce0c1-8262-48e1-96cb-446442d210a4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:38.192098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b8ce0c1-8262-48e1-96cb-446442d210a4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:38.192813 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b8ce0c1-8262-48e1-96cb-446442d210a4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:38.193959 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b8ce0c1-8262-48e1-96cb-446442d210a4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:38.199594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b8ce0c1-8262-48e1-96cb-446442d210a4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:38.219705 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8b8ce0c1-8262-48e1-96cb-446442d210a4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:38.315103 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-8b8ce0c1-8262-48e1-96cb-446442d210a4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.161546 Sep 01 15:02:38.319293 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 244/490] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 1 15:02:38 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf/os-volume_attachments => generated 25 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:38.465159 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f07a2745-9a04-4e50-afa0-fccd00411963 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:38.465677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f07a2745-9a04-4e50-afa0-fccd00411963 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:38.474168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f07a2745-9a04-4e50-afa0-fccd00411963 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:38.474979 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f07a2745-9a04-4e50-afa0-fccd00411963 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:38.475580 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f07a2745-9a04-4e50-afa0-fccd00411963 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:38.477398 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f07a2745-9a04-4e50-afa0-fccd00411963 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:38.478707 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f07a2745-9a04-4e50-afa0-fccd00411963 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:38.479305 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f07a2745-9a04-4e50-afa0-fccd00411963 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:38.497261 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-667460b4-753e-4ee0-bbda-de9293bf9680 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:38.511527 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-667460b4-753e-4ee0-bbda-de9293bf9680 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.403255 Sep 01 15:02:38.512901 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 247/491] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:38 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:38.527222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f07a2745-9a04-4e50-afa0-fccd00411963 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:02:38.653548 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f07a2745-9a04-4e50-afa0-fccd00411963 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 204 len: 0 microversion: 2.20 time: 0.190705 Sep 01 15:02:38.654766 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 245/492] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Sep 1 15:02:38 2022] DELETE /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 15:02:38.674623 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:38.677241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:38.691020 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:38.692431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:38.693477 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:38.695049 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:38.695772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:38.696612 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:38.889993 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:38.901825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:38.904895 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:38.906613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-066d0c90-bcaa-4ee4-8d11-2004b12e8b27 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.245213 Sep 01 15:02:38.919928 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 248/493] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:38 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:02:39.533765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-422c4842-dee2-4db3-8819-f05b8e5b7039 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:39.534590 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-422c4842-dee2-4db3-8819-f05b8e5b7039 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:39.548293 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-422c4842-dee2-4db3-8819-f05b8e5b7039 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:39.549326 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-422c4842-dee2-4db3-8819-f05b8e5b7039 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:39.549948 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-422c4842-dee2-4db3-8819-f05b8e5b7039 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:39.550883 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-422c4842-dee2-4db3-8819-f05b8e5b7039 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:39.551499 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-422c4842-dee2-4db3-8819-f05b8e5b7039 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:39.552110 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-422c4842-dee2-4db3-8819-f05b8e5b7039 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:39.935576 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:39.936314 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:39.951783 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:39.952609 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:39.953074 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:39.953821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:39.954309 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:39.954935 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:40.020878 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-422c4842-dee2-4db3-8819-f05b8e5b7039 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:40.034670 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-422c4842-dee2-4db3-8819-f05b8e5b7039 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.505196 Sep 01 15:02:40.038096 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 246/494] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:39 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:40.171987 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:40.189759 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:40.192203 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:40.193521 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ab22b576-a2bd-4587-b90a-a77ea1065192 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.263967 Sep 01 15:02:40.197453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 249/495] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:39 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:02:41.069973 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-52a1d00e-55a4-4772-8fbc-90955c13932c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:41.071987 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-52a1d00e-55a4-4772-8fbc-90955c13932c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:41.079744 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-52a1d00e-55a4-4772-8fbc-90955c13932c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:41.080505 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-52a1d00e-55a4-4772-8fbc-90955c13932c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:41.081168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-52a1d00e-55a4-4772-8fbc-90955c13932c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:41.082122 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-52a1d00e-55a4-4772-8fbc-90955c13932c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:41.082821 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-52a1d00e-55a4-4772-8fbc-90955c13932c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:41.083472 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-52a1d00e-55a4-4772-8fbc-90955c13932c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:41.219724 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:41.221084 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:41.229403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:41.230293 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:41.231093 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:41.232182 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:41.232860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:41.233504 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:41.359343 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-52a1d00e-55a4-4772-8fbc-90955c13932c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:41.380882 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-52a1d00e-55a4-4772-8fbc-90955c13932c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.315562 Sep 01 15:02:41.383847 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 247/496] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:41 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:41.449257 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:41.457698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:41.459406 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:41.461834 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-21a75dac-14b3-45c5-b5ec-1fa9bd918eaf tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.245081 Sep 01 15:02:41.463060 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 250/497] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:41 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:02:42.404906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-baca1b9d-1c14-4af5-bc2c-7bfd8eb3cfb0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:42.406485 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-baca1b9d-1c14-4af5-bc2c-7bfd8eb3cfb0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:42.414259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-baca1b9d-1c14-4af5-bc2c-7bfd8eb3cfb0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:42.415051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-baca1b9d-1c14-4af5-bc2c-7bfd8eb3cfb0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:42.415730 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-baca1b9d-1c14-4af5-bc2c-7bfd8eb3cfb0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:42.416675 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-baca1b9d-1c14-4af5-bc2c-7bfd8eb3cfb0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:42.417377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-baca1b9d-1c14-4af5-bc2c-7bfd8eb3cfb0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:42.418029 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-baca1b9d-1c14-4af5-bc2c-7bfd8eb3cfb0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:42.426101 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6a544303-49be-4ff2-8487-b08b865fd669 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Action: 'create', calling method: .version_select at 0x7fab73d99670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-971708312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICE72o0nc7HfvGtn4QPoIjTm7f4dAVbdOghs6tB7b3MNpZuYsbNxZp0klyj/Xic6WAAtYtv2CNFJ3gkuPlE78upa9RDvaKCRC4wMO7P08PwjiitrKqEnEUygcqj8Be9qw=="}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:42.471545 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-6a544303-49be-4ff2-8487-b08b865fd669 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Getting quotas for project 3e49151735934f21a2ea909842e36a05. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:02:42.482054 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-6a544303-49be-4ff2-8487-b08b865fd669 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Getting quotas for user afa6212f31034e27a8d32f114937190e and project 3e49151735934f21a2ea909842e36a05. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:02:42.565227 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6a544303-49be-4ff2-8487-b08b865fd669 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.372945 Sep 01 15:02:42.565991 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 248/498] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 1 15:02:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:02:42.574840 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:42.583034 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:42.597895 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:42.598533 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:42.599082 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:42.602840 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:42.603470 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:42.604080 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:42.609636 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:42.626256 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-baca1b9d-1c14-4af5-bc2c-7bfd8eb3cfb0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:42.636245 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-baca1b9d-1c14-4af5-bc2c-7bfd8eb3cfb0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.234913 Sep 01 15:02:42.636958 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 251/499] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:42 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:42.971914 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:42.983965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:42.985802 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:42.987233 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4dda199a-7f3f-4279-b1bf-8dff9f600e72 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.419735 Sep 01 15:02:42.988145 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 249/500] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:42 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:02:43.666357 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2094af89-3ff3-4727-bf57-ee1a7bf4585b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:43.667128 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2094af89-3ff3-4727-bf57-ee1a7bf4585b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:43.675570 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2094af89-3ff3-4727-bf57-ee1a7bf4585b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:43.676173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2094af89-3ff3-4727-bf57-ee1a7bf4585b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:43.676709 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2094af89-3ff3-4727-bf57-ee1a7bf4585b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:43.677490 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2094af89-3ff3-4727-bf57-ee1a7bf4585b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:43.678155 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2094af89-3ff3-4727-bf57-ee1a7bf4585b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:43.678678 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2094af89-3ff3-4727-bf57-ee1a7bf4585b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:43.855192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2094af89-3ff3-4727-bf57-ee1a7bf4585b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:43.865479 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2094af89-3ff3-4727-bf57-ee1a7bf4585b tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.203845 Sep 01 15:02:43.866396 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 252/501] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:43 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:44.013560 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:44.015613 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:44.022411 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:44.023504 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:44.023946 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:44.024680 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:44.025178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:44.025634 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:44.173019 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:44.182398 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:44.183830 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:44.185407 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-adf64172-3a3f-4041-a4d6-98ea02c48665 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.175385 Sep 01 15:02:44.186469 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 250/502] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:44 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:02:44.889202 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9c37c283-862c-40dd-a2a2-f46505eb7b83 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:44.889748 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9c37c283-862c-40dd-a2a2-f46505eb7b83 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:44.896202 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c37c283-862c-40dd-a2a2-f46505eb7b83 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:44.896685 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c37c283-862c-40dd-a2a2-f46505eb7b83 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:44.897125 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c37c283-862c-40dd-a2a2-f46505eb7b83 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:44.897860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c37c283-862c-40dd-a2a2-f46505eb7b83 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:44.898448 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c37c283-862c-40dd-a2a2-f46505eb7b83 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:44.898880 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9c37c283-862c-40dd-a2a2-f46505eb7b83 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:45.024149 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9c37c283-862c-40dd-a2a2-f46505eb7b83 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:45.032366 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9c37c283-862c-40dd-a2a2-f46505eb7b83 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.147017 Sep 01 15:02:45.032942 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 253/503] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:44 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:45.209436 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:45.209974 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:45.216360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:45.216843 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:45.217273 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:45.217953 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:45.218438 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:45.218863 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:45.381471 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:45.390030 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:45.391517 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:45.392683 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e358e0c6-c567-4cf5-96ec-93325707accd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.187257 Sep 01 15:02:45.393236 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 251/504] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:45 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:02:46.053879 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5a33513a-64e2-48f6-8d75-648e1cc82354 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:46.054546 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5a33513a-64e2-48f6-8d75-648e1cc82354 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:46.062025 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5a33513a-64e2-48f6-8d75-648e1cc82354 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:46.062574 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5a33513a-64e2-48f6-8d75-648e1cc82354 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:46.062988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5a33513a-64e2-48f6-8d75-648e1cc82354 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:46.063695 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5a33513a-64e2-48f6-8d75-648e1cc82354 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:46.064149 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5a33513a-64e2-48f6-8d75-648e1cc82354 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:46.064573 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5a33513a-64e2-48f6-8d75-648e1cc82354 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:46.240896 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-5a33513a-64e2-48f6-8d75-648e1cc82354 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:46.250916 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5a33513a-64e2-48f6-8d75-648e1cc82354 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.200909 Sep 01 15:02:46.251919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 254/505] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:46 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:46.415481 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:46.416635 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:46.419211 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:46.430188 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:46.434913 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:46.435368 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:46.436164 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:46.437167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:46.437613 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:46.696090 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:46.716444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:46.719578 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:46.725682 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7d77101f-0462-418e-ab57-3a2c06e4a9df tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1723 microversion: 2.20 time: 0.314233 Sep 01 15:02:46.732583 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 252/506] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:46 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:02:47.282096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-211275dc-7926-4b0d-a979-5b9bc91f8f25 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:47.283666 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-211275dc-7926-4b0d-a979-5b9bc91f8f25 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:47.288089 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:47.296704 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-211275dc-7926-4b0d-a979-5b9bc91f8f25 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:47.297203 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-211275dc-7926-4b0d-a979-5b9bc91f8f25 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:47.297651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-211275dc-7926-4b0d-a979-5b9bc91f8f25 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:47.298420 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-211275dc-7926-4b0d-a979-5b9bc91f8f25 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:47.300662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-211275dc-7926-4b0d-a979-5b9bc91f8f25 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:47.301099 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-211275dc-7926-4b0d-a979-5b9bc91f8f25 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:47.526284 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-211275dc-7926-4b0d-a979-5b9bc91f8f25 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:47.534861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-211275dc-7926-4b0d-a979-5b9bc91f8f25 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1735 microversion: 2.1 time: 0.265396 Sep 01 15:02:47.535436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 255/507] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:47 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1735 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:47.651484 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-3102f193-723c-4799-b50f-52aae1fa5f80 req-b0222cec-7de1-431b-b68e-095374cb758a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2570eed9-40bd-40ef-92d6-63b4e3cc83bf", "name": "network-vif-deleted", "tag": "2edcc91b-b083-48b1-bb53-84caae283791"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:47.676221 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3102f193-723c-4799-b50f-52aae1fa5f80 req-b0222cec-7de1-431b-b68e-095374cb758a service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:47.677257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3102f193-723c-4799-b50f-52aae1fa5f80 req-b0222cec-7de1-431b-b68e-095374cb758a service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:47.677754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3102f193-723c-4799-b50f-52aae1fa5f80 req-b0222cec-7de1-431b-b68e-095374cb758a service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:47.691667 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-3102f193-723c-4799-b50f-52aae1fa5f80 req-b0222cec-7de1-431b-b68e-095374cb758a service nova] Creating event network-vif-deleted:2edcc91b-b083-48b1-bb53-84caae283791 for instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf on hv-cinder-85505 Sep 01 15:02:47.696975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-3102f193-723c-4799-b50f-52aae1fa5f80 req-b0222cec-7de1-431b-b68e-095374cb758a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050171 Sep 01 15:02:47.698062 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 253/508] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:02:47.758578 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:47.759961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:47.768930 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:47.770035 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:47.770899 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:47.773992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:47.774777 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:47.775283 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:47.809450 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:47.886654 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:47.902734 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:47.904655 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:47.907122 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6b5b9df5-68ba-4138-9e10-401b95b6941e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1656 microversion: 2.20 time: 0.155918 Sep 01 15:02:47.926341 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 256/509] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:47 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1656 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:02:48.559871 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a80c8686-ce8b-45e9-85ca-6a41fe96923e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:48.561044 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a80c8686-ce8b-45e9-85ca-6a41fe96923e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:48.568423 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a80c8686-ce8b-45e9-85ca-6a41fe96923e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:48.569241 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a80c8686-ce8b-45e9-85ca-6a41fe96923e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:48.570541 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a80c8686-ce8b-45e9-85ca-6a41fe96923e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:48.572008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a80c8686-ce8b-45e9-85ca-6a41fe96923e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:48.572579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a80c8686-ce8b-45e9-85ca-6a41fe96923e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:48.573216 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a80c8686-ce8b-45e9-85ca-6a41fe96923e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:48.934279 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:48.934992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:48.941652 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:48.942440 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:48.943200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:48.944099 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:48.944664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:48.945302 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:48.984093 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:48.984688 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:48.985282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:48.985838 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lazy-loading 'fault' on Instance uuid 2570eed9-40bd-40ef-92d6-63b4e3cc83bf {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:02:49.018027 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a80c8686-ce8b-45e9-85ca-6a41fe96923e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:49.026466 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a80c8686-ce8b-45e9-85ca-6a41fe96923e tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1715 microversion: 2.1 time: 0.473051 Sep 01 15:02:49.027277 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 254/510] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:48 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1715 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:49.031106 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:49.043838 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:49.045351 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:49.046567 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a7d74c59-3102-440f-8aba-fd8dbffbf4d5 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 200 len: 1370 microversion: 2.20 time: 0.117477 Sep 01 15:02:49.047306 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 257/511] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:48 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 1370 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:02:49.155784 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:49.156323 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:49.164072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:49.164577 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:49.165024 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:49.165746 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:49.166213 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:49.166684 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:49.291251 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] HTTP exception thrown: Cannot 'detach_volume' instance da903e65-d948-457a-8d12-9253ffeacb02 while it is in vm_state rescued Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Request method failure captured: Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: DELETE /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-volume_attachments/e84390ab-9f50-4c59-a109-12cccaf74b61 HTTP/1.1 Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMidIN0JcFsmPkFozuW1JnVmhGyBAKw0aneJibf-YjO-MihBgOj2bcMNzZsVDgxifrpqibZcbsBfIaam-E-U_Accx2qFeg5B6aOKNhwHlqIN4boLjryK7job98_rcc-LVFONlHm9ujYdWfUeKbdmOrK0H2AEMxC7qHhhTMCvYvL3k1c Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 05e111f88e784eba929741c3cd250e78 Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:02:49.293329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:02:49.294732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/05e111f88e784eba929741c3cd250e78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/05e111f88e784eba929741c3cd250e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_05e111f88e784eba929741c3cd250e78", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/05e111f88e784eba929741c3cd250e78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:02:49.294732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:02:49.294732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 05e111f88e784eba929741c3cd250e78 Sep 01 15:02:49.294732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:02:49.294732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-ServerRescueNegativeTestJSON-2040884132-project Sep 01 15:02:49.294732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:02:49.294732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:02:49.294732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: df75151c37f74b6da7428dc290a274ff Sep 01 15:02:49.294732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2040884132-project Sep 01 15:02:49.294732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:02:49.294732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Cannot 'detach_volume' instance da903e65-d948-457a-8d12-9253ffeacb02 while it is in vm_state rescued Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'server_id': 'da903e65-d948-457a-8d12-9253ffeacb02', 'id': 'e84390ab-9f50-4c59-a109-12cccaf74b61'} Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance da903e65-d948-457a-8d12-9253ffeacb02 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:02:49.295495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance da903e65-d948-457a-8d12-9253ffeacb02 while it is in vm_state rescued Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance da903e65-d948-457a-8d12-9253ffeacb02 while it is in vm_state rescued Sep 01 15:02:49.296759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:02:49.300104 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Returning 409 to user: Cannot 'detach_volume' instance da903e65-d948-457a-8d12-9253ffeacb02 while it is in vm_state rescued {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:02:49.300961 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7cb820d3-14a2-4327-bb1b-30e052d757ae tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "DELETE /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-volume_attachments/e84390ab-9f50-4c59-a109-12cccaf74b61" status: 409 len: 152 microversion: 2.1 time: 0.149584 Sep 01 15:02:49.302211 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 255/512] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:02:49 2022] DELETE /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-volume_attachments/e84390ab-9f50-4c59-a109-12cccaf74b61 => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 15:02:49.311301 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-02ceca25-b9c6-4981-8ce5-bf4b52cc4968 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:49.312236 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-02ceca25-b9c6-4981-8ce5-bf4b52cc4968 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:49.321388 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-02ceca25-b9c6-4981-8ce5-bf4b52cc4968 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:49.322062 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-02ceca25-b9c6-4981-8ce5-bf4b52cc4968 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:49.322259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-02ceca25-b9c6-4981-8ce5-bf4b52cc4968 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:49.323626 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-02ceca25-b9c6-4981-8ce5-bf4b52cc4968 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:49.324052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-02ceca25-b9c6-4981-8ce5-bf4b52cc4968 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:49.324671 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-02ceca25-b9c6-4981-8ce5-bf4b52cc4968 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:49.413187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-02ceca25-b9c6-4981-8ce5-bf4b52cc4968 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "POST /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/action" status: 202 len: 0 microversion: 2.1 time: 0.105614 Sep 01 15:02:49.414768 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 258/513] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:02:49 2022] POST /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:02:49.424396 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-159aa0d8-5bbc-4f3c-b968-53ceee7494d0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:49.425024 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-159aa0d8-5bbc-4f3c-b968-53ceee7494d0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:49.432158 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-159aa0d8-5bbc-4f3c-b968-53ceee7494d0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:49.433029 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-159aa0d8-5bbc-4f3c-b968-53ceee7494d0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:49.433733 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-159aa0d8-5bbc-4f3c-b968-53ceee7494d0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:49.434695 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-159aa0d8-5bbc-4f3c-b968-53ceee7494d0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:49.435477 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-159aa0d8-5bbc-4f3c-b968-53ceee7494d0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:49.436144 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-159aa0d8-5bbc-4f3c-b968-53ceee7494d0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:49.608049 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-159aa0d8-5bbc-4f3c-b968-53ceee7494d0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:49.626167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-159aa0d8-5bbc-4f3c-b968-53ceee7494d0 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1723 microversion: 2.1 time: 0.206677 Sep 01 15:02:49.626909 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 256/514] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:49 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:50.077797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:50.080109 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:50.089432 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:50.090368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:50.091090 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:50.092035 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:50.092659 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:50.093244 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:50.118496 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] HTTP exception thrown: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Request method failure captured: Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf HTTP/1.1 Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMibvqu-4HZAE2EN8yss8gt18CAhQksvM8oDadnh-qdfDhEOyv8muvtYeV-2Ms19Ibd2VHZiT7UpJ0Xv6FID1lXZAa_kcmrmY_D8i5skxeH6hY0Ioee7k0Bd2l8MqsaxOotdUGUPmFXs0PJgcZLgk00zZ7hyuB2bVTqvmz5znZuD30A Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:02:50.120249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f02a6da81c440f9b61e4f2f90f37048", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 229e076684dd4bbdacda2231b18f0875 Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:02:50.122048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '2570eed9-40bd-40ef-92d6-63b4e3cc83bf'} Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:02:50.123347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:02:50.125442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:02:50.127892 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Returning 404 to user: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:02:50.128772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-25f3dc76-6737-45b9-a403-490b802590dc tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 404 len: 111 microversion: 2.20 time: 0.059531 Sep 01 15:02:50.129511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 259/515] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:50 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 15:02:50.138515 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-579c7d3a-7048-4bbb-8127-4ba64e51eb6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '.version_select at 0x7fab73d66ca0>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:50.180829 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-579c7d3a-7048-4bbb-8127-4ba64e51eb6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-168008325" status: 204 len: 0 microversion: 2.20 time: 0.046151 Sep 01 15:02:50.182154 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 257/516] 10.222.0.33 () {60 vars in 1259 bytes} [Thu Sep 1 15:02:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-168008325 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 15:02:50.383818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8ba2d9bb-4015-4f0d-9120-b24b077b4cd1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:50.384516 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8ba2d9bb-4015-4f0d-9120-b24b077b4cd1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:50.397347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8ba2d9bb-4015-4f0d-9120-b24b077b4cd1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:50.398064 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8ba2d9bb-4015-4f0d-9120-b24b077b4cd1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:50.398753 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8ba2d9bb-4015-4f0d-9120-b24b077b4cd1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:50.399356 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8ba2d9bb-4015-4f0d-9120-b24b077b4cd1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:50.400039 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8ba2d9bb-4015-4f0d-9120-b24b077b4cd1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:50.401035 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8ba2d9bb-4015-4f0d-9120-b24b077b4cd1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:50.520233 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-8ba2d9bb-4015-4f0d-9120-b24b077b4cd1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lazy-loading 'services' on Instance uuid 55e7d0e5-5c57-4ed2-b230-f8fb40968842 {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:02:50.617275 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8ba2d9bb-4015-4f0d-9120-b24b077b4cd1 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842/os-volume_attachments/10951530-1a79-4f64-abdc-530bf08b475c" status: 202 len: 0 microversion: 2.1 time: 0.242864 Sep 01 15:02:50.618359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 260/517] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:02:50 2022] DELETE /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842/os-volume_attachments/10951530-1a79-4f64-abdc-530bf08b475c => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:02:50.648823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d5ae6190-a46c-4e7e-804c-aed71608ac4d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:50.650090 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d5ae6190-a46c-4e7e-804c-aed71608ac4d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:50.660124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d5ae6190-a46c-4e7e-804c-aed71608ac4d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:50.661659 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d5ae6190-a46c-4e7e-804c-aed71608ac4d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:50.662411 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d5ae6190-a46c-4e7e-804c-aed71608ac4d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:50.665100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d5ae6190-a46c-4e7e-804c-aed71608ac4d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:50.665843 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d5ae6190-a46c-4e7e-804c-aed71608ac4d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:50.666731 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d5ae6190-a46c-4e7e-804c-aed71608ac4d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:50.805937 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d5ae6190-a46c-4e7e-804c-aed71608ac4d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:50.815016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d5ae6190-a46c-4e7e-804c-aed71608ac4d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1723 microversion: 2.1 time: 0.170496 Sep 01 15:02:50.815590 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 258/518] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:50 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:51.000311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-fa8fedff-c0b7-456c-ae6f-0a8a91441a54 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Action: 'create', calling method: .version_select at 0x7fab73ee9dc0>, body: {"keypair": {"name": "tempest-keypair-314196941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUqQdzCeJhZkU4H9Q3ew2TozH4j33kvRPlNBGi8cGFDC21xX9UjR7X8A6kJP7r5sYWmm/VBZidhevilECqQcDBadLvTgtAhUlndKLkL73X7IXN700ZKgm4f6UajKxmb1Q=="}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:51.018775 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-fa8fedff-c0b7-456c-ae6f-0a8a91441a54 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Getting quotas for project 2f02a6da81c440f9b61e4f2f90f37048. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:02:51.023962 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-fa8fedff-c0b7-456c-ae6f-0a8a91441a54 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Getting quotas for user 229e076684dd4bbdacda2231b18f0875 and project 2f02a6da81c440f9b61e4f2f90f37048. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:02:51.049300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-fa8fedff-c0b7-456c-ae6f-0a8a91441a54 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052887 Sep 01 15:02:51.054119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 261/519] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Sep 1 15:02:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 15:02:51.842545 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-abca5699-e476-45e2-9ee9-e8a356860f65 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:51.849233 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-abca5699-e476-45e2-9ee9-e8a356860f65 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:51.866758 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abca5699-e476-45e2-9ee9-e8a356860f65 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:51.867690 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abca5699-e476-45e2-9ee9-e8a356860f65 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:51.868579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abca5699-e476-45e2-9ee9-e8a356860f65 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:51.869659 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abca5699-e476-45e2-9ee9-e8a356860f65 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:51.870312 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abca5699-e476-45e2-9ee9-e8a356860f65 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:51.871089 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abca5699-e476-45e2-9ee9-e8a356860f65 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:52.058014 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-abca5699-e476-45e2-9ee9-e8a356860f65 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:52.067592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-abca5699-e476-45e2-9ee9-e8a356860f65 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1723 microversion: 2.1 time: 0.233372 Sep 01 15:02:52.070277 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 259/520] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:51 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:52.541603 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-233981850", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "385d3105-2fe8-4ab1-9773-5b604909969c"}], "security_groups": [{"name": "tempest-securitygroup--361232654"}], "key_name": "tempest-keypair-314196941", "user_data": "}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:52.667701 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.network.neutron [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] validate_networks() for [('385d3105-2fe8-4ab1-9773-5b604909969c', None, None, None, None, None)] {{(pid=120553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:02:53.090795 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=4 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:02:53.101736 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ecfde7d8-7240-4a60-8fc4-31f96ab731c6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:53.102924 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ecfde7d8-7240-4a60-8fc4-31f96ab731c6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:53.114784 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfde7d8-7240-4a60-8fc4-31f96ab731c6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:53.115592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfde7d8-7240-4a60-8fc4-31f96ab731c6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:53.116360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfde7d8-7240-4a60-8fc4-31f96ab731c6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:53.117596 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfde7d8-7240-4a60-8fc4-31f96ab731c6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:53.118449 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfde7d8-7240-4a60-8fc4-31f96ab731c6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:53.119218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfde7d8-7240-4a60-8fc4-31f96ab731c6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:53.227087 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Flavor limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:02:53.228355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Image limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:02:53.230143 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Flavor pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:02:53.230901 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Image pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:02:53.231874 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:02:53.246781 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:53.247548 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:53.258829 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:53.260660 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:53.261775 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:53.270103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:53.288658 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Getting quotas for project 2f02a6da81c440f9b61e4f2f90f37048. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:02:53.293854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Getting quotas for user 229e076684dd4bbdacda2231b18f0875 and project 2f02a6da81c440f9b61e4f2f90f37048. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:02:53.306770 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Going to run 1 instances... {{(pid=120553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:02:53.309351 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:02:53.329093 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ecfde7d8-7240-4a60-8fc4-31f96ab731c6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:53.338324 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ecfde7d8-7240-4a60-8fc4-31f96ab731c6 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1729 microversion: 2.1 time: 0.250391 Sep 01 15:02:53.349793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 260/521] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:53 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1729 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:53.361937 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5ec57e4f-fd83-4e6f-b5d3-c3e87d159b0c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:53.362471 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5ec57e4f-fd83-4e6f-b5d3-c3e87d159b0c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:53.365587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1d37d972-9fec-427a-9d8c-0c2f3a60af6d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.832319 Sep 01 15:02:53.366128 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 262/522] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Sep 1 15:02:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 15:02:53.369242 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ec57e4f-fd83-4e6f-b5d3-c3e87d159b0c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:53.369745 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ec57e4f-fd83-4e6f-b5d3-c3e87d159b0c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:53.370194 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ec57e4f-fd83-4e6f-b5d3-c3e87d159b0c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:53.370971 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ec57e4f-fd83-4e6f-b5d3-c3e87d159b0c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:53.371432 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ec57e4f-fd83-4e6f-b5d3-c3e87d159b0c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:53.371864 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5ec57e4f-fd83-4e6f-b5d3-c3e87d159b0c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:53.378033 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8e9c51b1-1bbb-430e-807a-5bfbd3e65303 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:53.378839 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8e9c51b1-1bbb-430e-807a-5bfbd3e65303 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:53.437838 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8e9c51b1-1bbb-430e-807a-5bfbd3e65303 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:53.445608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8e9c51b1-1bbb-430e-807a-5bfbd3e65303 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:53.447797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8e9c51b1-1bbb-430e-807a-5bfbd3e65303 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:53.448948 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8e9c51b1-1bbb-430e-807a-5bfbd3e65303 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1280 microversion: 2.20 time: 0.075500 Sep 01 15:02:53.449857 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 263/523] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:53 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:02:53.486090 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5ec57e4f-fd83-4e6f-b5d3-c3e87d159b0c tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128977 Sep 01 15:02:53.486715 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 261/524] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 1 15:02:53 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:02:53.895732 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-007cf5d0-82e9-4b00-ad69-785bda5989ff tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:53.896378 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-007cf5d0-82e9-4b00-ad69-785bda5989ff tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:53.908587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-007cf5d0-82e9-4b00-ad69-785bda5989ff tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:53.909236 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-007cf5d0-82e9-4b00-ad69-785bda5989ff tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:53.909778 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-007cf5d0-82e9-4b00-ad69-785bda5989ff tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:53.910627 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-007cf5d0-82e9-4b00-ad69-785bda5989ff tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:53.911358 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-007cf5d0-82e9-4b00-ad69-785bda5989ff tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:53.912027 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-007cf5d0-82e9-4b00-ad69-785bda5989ff tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:53.940935 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-007cf5d0-82e9-4b00-ad69-785bda5989ff tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Going to try to terminate instance {{(pid=120553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:02:54.034915 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-007cf5d0-82e9-4b00-ad69-785bda5989ff tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "DELETE /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 204 len: 0 microversion: 2.1 time: 0.143001 Sep 01 15:02:54.036744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 264/525] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:02:53 2022] DELETE /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:02:54.044923 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-8c6ed488-8a65-47d6-91be-c884198b3ba2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:54.045555 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-8c6ed488-8a65-47d6-91be-c884198b3ba2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:54.052008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8c6ed488-8a65-47d6-91be-c884198b3ba2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:54.052747 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8c6ed488-8a65-47d6-91be-c884198b3ba2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:54.053162 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8c6ed488-8a65-47d6-91be-c884198b3ba2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:54.053970 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8c6ed488-8a65-47d6-91be-c884198b3ba2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:54.054468 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8c6ed488-8a65-47d6-91be-c884198b3ba2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:54.054905 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8c6ed488-8a65-47d6-91be-c884198b3ba2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:54.202653 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-8c6ed488-8a65-47d6-91be-c884198b3ba2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:54.211808 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-8c6ed488-8a65-47d6-91be-c884198b3ba2 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1513 microversion: 2.1 time: 0.170762 Sep 01 15:02:54.212384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 262/526] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:54 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:02:54.476636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:54.477429 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:54.483517 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:54.484074 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:54.484516 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:54.485259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:54.485720 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:54.486150 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:54.553600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:54.563011 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:54.564463 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:54.565584 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-45cd2048-62a6-4ece-b92a-ecec5fc4ea8e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1332 microversion: 2.20 time: 0.094588 Sep 01 15:02:54.566137 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 265/527] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:54 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:02:54.733982 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-b164ff48-e9fd-4092-a7a4-b71610f3cc2e req-bc794770-26fc-46d9-b8f7-599f8e5d794c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da903e65-d948-457a-8d12-9253ffeacb02", "tag": "c6295804-bbdf-4e7a-af58-cedd94bf76a7"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:54.750646 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b164ff48-e9fd-4092-a7a4-b71610f3cc2e req-bc794770-26fc-46d9-b8f7-599f8e5d794c service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:54.751130 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b164ff48-e9fd-4092-a7a4-b71610f3cc2e req-bc794770-26fc-46d9-b8f7-599f8e5d794c service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:54.751565 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b164ff48-e9fd-4092-a7a4-b71610f3cc2e req-bc794770-26fc-46d9-b8f7-599f8e5d794c service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:54.763915 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-b164ff48-e9fd-4092-a7a4-b71610f3cc2e req-bc794770-26fc-46d9-b8f7-599f8e5d794c service nova] Creating event network-changed:c6295804-bbdf-4e7a-af58-cedd94bf76a7 for instance da903e65-d948-457a-8d12-9253ffeacb02 on hv-cinder-85505 Sep 01 15:02:54.769012 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-b164ff48-e9fd-4092-a7a4-b71610f3cc2e req-bc794770-26fc-46d9-b8f7-599f8e5d794c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038875 Sep 01 15:02:54.769598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 263/528] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:02:55.233485 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8b775f64-f3ac-4e57-8ba7-56949962dfdc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:55.234085 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8b775f64-f3ac-4e57-8ba7-56949962dfdc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:55.240742 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8b775f64-f3ac-4e57-8ba7-56949962dfdc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:55.242052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8b775f64-f3ac-4e57-8ba7-56949962dfdc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:55.242570 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8b775f64-f3ac-4e57-8ba7-56949962dfdc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:55.243225 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8b775f64-f3ac-4e57-8ba7-56949962dfdc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:55.243691 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8b775f64-f3ac-4e57-8ba7-56949962dfdc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:55.244122 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8b775f64-f3ac-4e57-8ba7-56949962dfdc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:55.381897 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8b775f64-f3ac-4e57-8ba7-56949962dfdc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:55.389587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8b775f64-f3ac-4e57-8ba7-56949962dfdc tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1513 microversion: 2.1 time: 0.159968 Sep 01 15:02:55.390152 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 266/529] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:55 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:55.590574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:55.591299 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:55.597346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:55.597831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:55.598399 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:55.599087 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:55.599541 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:55.599967 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:55.674443 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:55.683673 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:55.686022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:55.687444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3f521457-def6-4b10-a0c3-02252003b4a1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1332 microversion: 2.20 time: 0.101578 Sep 01 15:02:55.695437 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 264/530] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:55 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:02:56.419185 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-40ce8114-de48-433f-a78e-863ed4fecad8 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:56.420404 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-40ce8114-de48-433f-a78e-863ed4fecad8 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:56.430037 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-40ce8114-de48-433f-a78e-863ed4fecad8 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:56.431592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-40ce8114-de48-433f-a78e-863ed4fecad8 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:56.432277 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-40ce8114-de48-433f-a78e-863ed4fecad8 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:56.433485 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-40ce8114-de48-433f-a78e-863ed4fecad8 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:56.434355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-40ce8114-de48-433f-a78e-863ed4fecad8 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:56.435012 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-40ce8114-de48-433f-a78e-863ed4fecad8 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:56.704392 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-40ce8114-de48-433f-a78e-863ed4fecad8 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b4bf3f69204fc896c996bcaa9e087e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53f5d57b243e421cbf8d929cafe9c860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:56.709008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:56.713409 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:56.715824 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-40ce8114-de48-433f-a78e-863ed4fecad8 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 200 len: 1513 microversion: 2.1 time: 0.308310 Sep 01 15:02:56.716401 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 267/531] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:56 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 1513 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:02:56.721201 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:56.722525 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:56.723036 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:56.723824 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:56.724354 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:56.724857 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:56.754672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-de345b91-d8fb-4e1d-8670-635183d40160 req-34d29538-300c-455f-a34c-3f5e1b0bf20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e7d0e5-5c57-4ed2-b230-f8fb40968842", "name": "network-vif-deleted", "tag": "eb3feb67-a40e-4252-8e4e-65a5a38bd5bf"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:56.766989 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-de345b91-d8fb-4e1d-8670-635183d40160 req-34d29538-300c-455f-a34c-3f5e1b0bf20b service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:56.767730 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-de345b91-d8fb-4e1d-8670-635183d40160 req-34d29538-300c-455f-a34c-3f5e1b0bf20b service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:56.768334 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-de345b91-d8fb-4e1d-8670-635183d40160 req-34d29538-300c-455f-a34c-3f5e1b0bf20b service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:56.786613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-de345b91-d8fb-4e1d-8670-635183d40160 req-34d29538-300c-455f-a34c-3f5e1b0bf20b service nova] Creating event network-vif-deleted:eb3feb67-a40e-4252-8e4e-65a5a38bd5bf for instance 55e7d0e5-5c57-4ed2-b230-f8fb40968842 on hv-cinder-85505 Sep 01 15:02:56.792424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-de345b91-d8fb-4e1d-8670-635183d40160 req-34d29538-300c-455f-a34c-3f5e1b0bf20b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041739 Sep 01 15:02:56.793178 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 268/532] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:02:56.812073 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:56.821167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:56.823062 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:56.824830 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9d09b170-d846-45b9-8b07-712064ec354b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1338 microversion: 2.20 time: 0.119458 Sep 01 15:02:56.825891 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 265/533] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:56 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1338 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:02:56.844889 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-6b7e2965-a45d-42e6-9875-215d4a42a090 req-e372f5ca-e729-462b-9d40-64ec55b7ba01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da903e65-d948-457a-8d12-9253ffeacb02", "tag": "c6295804-bbdf-4e7a-af58-cedd94bf76a7"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:56.856404 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-6b7e2965-a45d-42e6-9875-215d4a42a090 req-e372f5ca-e729-462b-9d40-64ec55b7ba01 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:56.857239 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-6b7e2965-a45d-42e6-9875-215d4a42a090 req-e372f5ca-e729-462b-9d40-64ec55b7ba01 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:56.857926 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-6b7e2965-a45d-42e6-9875-215d4a42a090 req-e372f5ca-e729-462b-9d40-64ec55b7ba01 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:56.869060 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-6b7e2965-a45d-42e6-9875-215d4a42a090 req-e372f5ca-e729-462b-9d40-64ec55b7ba01 service nova] Creating event network-changed:c6295804-bbdf-4e7a-af58-cedd94bf76a7 for instance da903e65-d948-457a-8d12-9253ffeacb02 on hv-cinder-85505 Sep 01 15:02:56.873873 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-6b7e2965-a45d-42e6-9875-215d4a42a090 req-e372f5ca-e729-462b-9d40-64ec55b7ba01 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035960 Sep 01 15:02:56.874818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 269/534] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:02:57.736867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:57.737579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] [instance: 55e7d0e5-5c57-4ed2-b230-f8fb40968842] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:57.744821 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:57.745317 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:57.745814 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:57.746559 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:57.747033 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:57.747461 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:57.761578 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] HTTP exception thrown: Instance 55e7d0e5-5c57-4ed2-b230-f8fb40968842 could not be found. Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Request method failure captured: Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 HTTP/1.1 Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMkmBdI7UMo1pCCOjFbYUS1VC2KfT47_drGtXzWBbbqKnU1VvPqN3CCCmC8qBuJD_0d7TKeTKDIINX8vcoIexRBrQBXDKvbuAx_77fSTUe7Vgb5xLQA3F7u5Q32AFcTI8gMewK0eUzHbuiB7I5w1aBmf70NTxw35ImtyWs5NLTMjLOg Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 53f5d57b243e421cbf8d929cafe9c860 Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-VolumesSnapshotTestJSON-420185671 Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:02:57.763393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53f5d57b243e421cbf8d929cafe9c860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53f5d57b243e421cbf8d929cafe9c860"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53f5d57b243e421cbf8d929cafe9c860", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53f5d57b243e421cbf8d929cafe9c860"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-VolumesSnapshotTestJSON-420185671 Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 53f5d57b243e421cbf8d929cafe9c860 Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-420185671 Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-VolumesSnapshotTestJSON-420185671-project Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 74b4bf3f69204fc896c996bcaa9e087e Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-VolumesSnapshotTestJSON-420185671-project Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 55e7d0e5-5c57-4ed2-b230-f8fb40968842 could not be found. Sep 01 15:02:57.765001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '55e7d0e5-5c57-4ed2-b230-f8fb40968842'} Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55e7d0e5-5c57-4ed2-b230-f8fb40968842 could not be found. Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:02:57.765827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55e7d0e5-5c57-4ed2-b230-f8fb40968842 could not be found. Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55e7d0e5-5c57-4ed2-b230-f8fb40968842 could not be found. Sep 01 15:02:57.767212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:02:57.768381 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] Returning 404 to user: Instance 55e7d0e5-5c57-4ed2-b230-f8fb40968842 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:02:57.768381 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-121f7589-c8a5-43ed-b6ae-4f822cd24866 tempest-VolumesSnapshotTestJSON-420185671 tempest-VolumesSnapshotTestJSON-420185671-project] 10.222.0.33 "GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842" status: 404 len: 111 microversion: 2.1 time: 0.031760 Sep 01 15:02:57.768381 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 266/535] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:02:57 2022] GET /compute/v2.1/servers/55e7d0e5-5c57-4ed2-b230-f8fb40968842 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:02:57.850251 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:57.851914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:57.861789 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:57.862380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:57.862768 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:57.863511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:57.864296 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:57.864941 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:58.084595 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:58.093398 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:58.094888 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:58.096027 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-555024bb-c9b8-41a9-a2b5-fb392ec35d01 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.250914 Sep 01 15:02:58.096580 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 270/536] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:57 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:02:58.887810 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-498ae96d-bb65-49ea-9008-2c0a8f7222ed req-448b6ae0-6205-41cf-b36a-e7d707df337e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea0e09a-fcb0-4aab-844d-c9b7d170ec95", "tag": "2c6c7ac6-7b01-495d-911b-2cf5b78b8904"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:02:58.898100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-498ae96d-bb65-49ea-9008-2c0a8f7222ed req-448b6ae0-6205-41cf-b36a-e7d707df337e service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:58.898613 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-498ae96d-bb65-49ea-9008-2c0a8f7222ed req-448b6ae0-6205-41cf-b36a-e7d707df337e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:58.899052 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-498ae96d-bb65-49ea-9008-2c0a8f7222ed req-448b6ae0-6205-41cf-b36a-e7d707df337e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:58.909932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-498ae96d-bb65-49ea-9008-2c0a8f7222ed req-448b6ae0-6205-41cf-b36a-e7d707df337e service nova] Creating event network-changed:2c6c7ac6-7b01-495d-911b-2cf5b78b8904 for instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 on hv-cinder-85505 Sep 01 15:02:58.914804 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-498ae96d-bb65-49ea-9008-2c0a8f7222ed req-448b6ae0-6205-41cf-b36a-e7d707df337e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030568 Sep 01 15:02:58.915307 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 267/537] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:02:59.118737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:02:59.119414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:02:59.125995 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:59.126592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:59.127107 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:59.127886 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:02:59.128429 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:02:59.128866 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:02:59.265384 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:59.274836 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:59.276565 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:02:59.280150 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-49c167e8-3534-426c-8969-ca053c77a4f0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.165209 Sep 01 15:02:59.281022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 271/538] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:02:59 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:00.305085 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:00.305781 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:00.312197 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:00.312684 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:00.313122 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:00.313816 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:00.314289 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:00.314716 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:00.447766 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:00.456233 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:00.457810 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:00.458847 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d51d7c41-e945-4440-aa5f-3ce1a26c5042 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.159143 Sep 01 15:03:00.459428 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 268/539] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:00 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:01.481791 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:01.482455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:01.488951 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:01.489436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:01.489883 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:01.490607 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:01.491569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:01.491995 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:01.638808 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:01.649357 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:01.651181 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:01.652398 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-dda9393a-6ec8-4705-a821-ac8b51caecba tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.174459 Sep 01 15:03:01.652957 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 272/540] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:01 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:02.680360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:02.680360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:02.684582 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:02.685062 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:02.685499 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:02.686194 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:02.686671 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:02.687626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:02.824851 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:02.828561 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=100 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:02.834219 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:02.835697 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:02.836805 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-24b1c812-2024-4f7a-8d3d-195e93a55007 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.164337 Sep 01 15:03:02.837352 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 269/541] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:02 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:03.859158 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:03.859818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:03.861812 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:03.862569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=12 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:03.868170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:03.868658 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:03.869100 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:03.869795 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:03.870268 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:03.870702 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:04.014792 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:04.023980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:04.027732 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:04.027732 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1001fe97-904e-460b-92c5-63c464911b0b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.171506 Sep 01 15:03:04.027732 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 273/542] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:03 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:04.846875 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-911753159", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-971708312", "security_groups": [{"name": "tempest-secgroup-smoke-247398210"}], "block_device_mapping_v2": [{"uuid": "8e89ba33-63ee-47c1-8689-87b2cd01f6d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "056da220-38ab-4965-aff0-511e66373f02"}]}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:04.973519 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.network.neutron [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] validate_networks() for [('056da220-38ab-4965-aff0-511e66373f02', None, None, None, None, None)] {{(pid=120554) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:03:05.050057 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:05.050646 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:05.057212 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:05.057702 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:05.058141 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:05.058898 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:05.059358 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:05.059788 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:05.075457 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:05.199167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:05.207269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:05.208718 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:05.210504 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-482a4035-ccf9-410e-a26f-958eafb2fc76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.164050 Sep 01 15:03:05.211064 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 274/543] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:05 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:05.372006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Flavor limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:03:05.372675 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Image limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:03:05.373381 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Flavor pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:03:05.374062 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Image pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:03:05.374707 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:03:05.387288 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:05.387994 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:05.388700 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:05.389787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:05.390295 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:05.390738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:05.407967 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Getting quotas for project 3e49151735934f21a2ea909842e36a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:03:05.411966 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Getting quotas for user afa6212f31034e27a8d32f114937190e and project 3e49151735934f21a2ea909842e36a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:03:05.477544 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Going to run 1 instances... {{(pid=120554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:03:05.477544 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e89ba33-63ee-47c1-8689-87b2cd01f6d8',volume_size=None,volume_type=None)] {{(pid=120554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:03:05.621157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e08c4e4e-986c-4ac8-a1b3-a037746072d9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.777913 Sep 01 15:03:05.621714 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 270/544] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:03:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:03:05.633107 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f299b967-3f7f-4842-8860-83942433296e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:05.633731 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f299b967-3f7f-4842-8860-83942433296e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:05.690337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f299b967-3f7f-4842-8860-83942433296e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:05.697903 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f299b967-3f7f-4842-8860-83942433296e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1093 microversion: 2.1 time: 0.069209 Sep 01 15:03:05.698503 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 275/545] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:05 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:06.242728 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:06.244068 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:06.252965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:06.253737 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:06.254425 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:06.255357 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:06.256196 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:06.256778 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:06.446039 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:06.462999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:06.464466 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:06.465766 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-91d20ce2-2f1e-4c6d-8856-16c36e243031 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.228075 Sep 01 15:03:06.471995 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 271/546] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:06 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:06.707250 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-bc267aa8-5a34-4432-9264-dc5628d392c6 req-a91894ad-79c4-4bf9-a65b-9af627717723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea0e09a-fcb0-4aab-844d-c9b7d170ec95", "name": "network-vif-plugged", "status": "completed", "tag": "2c6c7ac6-7b01-495d-911b-2cf5b78b8904"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:06.718073 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-bc267aa8-5a34-4432-9264-dc5628d392c6 req-a91894ad-79c4-4bf9-a65b-9af627717723 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:06.718816 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-bc267aa8-5a34-4432-9264-dc5628d392c6 req-a91894ad-79c4-4bf9-a65b-9af627717723 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:06.719433 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b2f27bc8-f99b-4ea0-895d-c06149aad6ee tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:06.719631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-bc267aa8-5a34-4432-9264-dc5628d392c6 req-a91894ad-79c4-4bf9-a65b-9af627717723 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:06.720233 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b2f27bc8-f99b-4ea0-895d-c06149aad6ee tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:06.728419 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b2f27bc8-f99b-4ea0-895d-c06149aad6ee tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:06.728909 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b2f27bc8-f99b-4ea0-895d-c06149aad6ee tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:06.729333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b2f27bc8-f99b-4ea0-895d-c06149aad6ee tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:06.730048 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b2f27bc8-f99b-4ea0-895d-c06149aad6ee tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:06.730517 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b2f27bc8-f99b-4ea0-895d-c06149aad6ee tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:06.730942 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b2f27bc8-f99b-4ea0-895d-c06149aad6ee tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:06.734454 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-bc267aa8-5a34-4432-9264-dc5628d392c6 req-a91894ad-79c4-4bf9-a65b-9af627717723 service nova] Creating event network-vif-plugged:2c6c7ac6-7b01-495d-911b-2cf5b78b8904 for instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 on hv-cinder-85505 Sep 01 15:03:06.741992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-bc267aa8-5a34-4432-9264-dc5628d392c6 req-a91894ad-79c4-4bf9-a65b-9af627717723 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037828 Sep 01 15:03:06.742637 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 276/547] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:03:06.811077 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b2f27bc8-f99b-4ea0-895d-c06149aad6ee tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:06.821836 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b2f27bc8-f99b-4ea0-895d-c06149aad6ee tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1191 microversion: 2.1 time: 0.106880 Sep 01 15:03:06.822452 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 272/548] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:06 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1191 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:07.489737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:07.491019 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:07.499576 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:07.500063 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:07.500501 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:07.501202 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:07.501781 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:07.502209 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:07.700360 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:07.711024 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:07.713935 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:07.715607 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e9f768b0-be6b-4819-9554-dd05bdb3f312 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.230926 Sep 01 15:03:07.716166 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 277/549] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:07 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:07.843487 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6d540baf-0369-449f-bb6d-89b2a003f645 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:07.844301 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6d540baf-0369-449f-bb6d-89b2a003f645 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:07.851318 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d540baf-0369-449f-bb6d-89b2a003f645 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:07.851813 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d540baf-0369-449f-bb6d-89b2a003f645 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:07.852377 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d540baf-0369-449f-bb6d-89b2a003f645 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:07.852954 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d540baf-0369-449f-bb6d-89b2a003f645 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:07.853421 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d540baf-0369-449f-bb6d-89b2a003f645 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:07.853857 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d540baf-0369-449f-bb6d-89b2a003f645 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:08.009860 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6d540baf-0369-449f-bb6d-89b2a003f645 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:08.018691 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6d540baf-0369-449f-bb6d-89b2a003f645 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1276 microversion: 2.1 time: 0.179615 Sep 01 15:03:08.019265 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 273/550] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:07 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:08.738959 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:08.739617 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:08.747177 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:08.747686 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:08.748120 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:08.748817 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:08.749275 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:08.749700 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:08.885599 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:08.893694 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:08.895161 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:08.896269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-036562a8-4b12-4461-a3d2-e6f8d8ff6113 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.161239 Sep 01 15:03:08.896813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 278/551] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:08 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:09.040817 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-442d5c7f-963e-461c-9bc8-c7c30a801dda tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:09.041430 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-442d5c7f-963e-461c-9bc8-c7c30a801dda tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:09.047880 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-442d5c7f-963e-461c-9bc8-c7c30a801dda tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:09.048367 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-442d5c7f-963e-461c-9bc8-c7c30a801dda tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:09.049060 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-442d5c7f-963e-461c-9bc8-c7c30a801dda tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:09.049752 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-442d5c7f-963e-461c-9bc8-c7c30a801dda tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:09.050205 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-442d5c7f-963e-461c-9bc8-c7c30a801dda tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:09.050657 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-442d5c7f-963e-461c-9bc8-c7c30a801dda tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:09.184597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-442d5c7f-963e-461c-9bc8-c7c30a801dda tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:09.192493 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-442d5c7f-963e-461c-9bc8-c7c30a801dda tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1276 microversion: 2.1 time: 0.156175 Sep 01 15:03:09.193080 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 274/552] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:09 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:09.918805 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:09.919357 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:09.926009 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:09.926518 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:09.926952 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:09.927671 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:09.928133 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:09.928545 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:10.063496 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:10.074095 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:10.075702 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:10.076818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f6237ac6-74f3-46d4-b0cb-38a6d6b521d1 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.161940 Sep 01 15:03:10.077446 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 279/553] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:09 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:10.213683 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5205610a-c27e-422b-b229-22f364af2f6f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:10.214223 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5205610a-c27e-422b-b229-22f364af2f6f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:10.220583 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5205610a-c27e-422b-b229-22f364af2f6f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:10.221064 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5205610a-c27e-422b-b229-22f364af2f6f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:10.221498 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5205610a-c27e-422b-b229-22f364af2f6f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:10.222189 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5205610a-c27e-422b-b229-22f364af2f6f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:10.222666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5205610a-c27e-422b-b229-22f364af2f6f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:10.223086 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5205610a-c27e-422b-b229-22f364af2f6f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:10.355430 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-5205610a-c27e-422b-b229-22f364af2f6f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:10.363393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5205610a-c27e-422b-b229-22f364af2f6f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1276 microversion: 2.1 time: 0.154163 Sep 01 15:03:10.363961 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 275/554] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:10 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:11.104455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:11.105067 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:11.111683 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:11.112235 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:11.112679 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:11.113379 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:11.113846 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:11.114295 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:11.318731 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:11.327188 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:11.328741 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:11.329993 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-eac70a88-3f43-4f2e-89fa-9dd0fc408663 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1405 microversion: 2.20 time: 0.230068 Sep 01 15:03:11.342705 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 280/555] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:11 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:11.368871 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-07dd19bf-9239-4999-871b-3d681dc9f1b6 req-fd0828fa-4dc2-4b5b-872b-3536e804d569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4561748-1530-48b0-b782-1bceb2ecb240", "tag": "9df92666-196a-402d-a511-48632bf3326d"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:11.380410 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-07dd19bf-9239-4999-871b-3d681dc9f1b6 req-fd0828fa-4dc2-4b5b-872b-3536e804d569 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:11.381184 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-07dd19bf-9239-4999-871b-3d681dc9f1b6 req-fd0828fa-4dc2-4b5b-872b-3536e804d569 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:11.381840 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-07dd19bf-9239-4999-871b-3d681dc9f1b6 req-fd0828fa-4dc2-4b5b-872b-3536e804d569 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:11.384184 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e12dc6ba-88e4-4947-9aaa-81df43ba45e9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:11.384797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e12dc6ba-88e4-4947-9aaa-81df43ba45e9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:11.391313 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e12dc6ba-88e4-4947-9aaa-81df43ba45e9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:11.392019 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e12dc6ba-88e4-4947-9aaa-81df43ba45e9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:11.392979 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e12dc6ba-88e4-4947-9aaa-81df43ba45e9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:11.393521 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-07dd19bf-9239-4999-871b-3d681dc9f1b6 req-fd0828fa-4dc2-4b5b-872b-3536e804d569 service nova] Creating event network-changed:9df92666-196a-402d-a511-48632bf3326d for instance e4561748-1530-48b0-b782-1bceb2ecb240 on hv-cinder-85505 Sep 01 15:03:11.393861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e12dc6ba-88e4-4947-9aaa-81df43ba45e9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:11.395029 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e12dc6ba-88e4-4947-9aaa-81df43ba45e9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:11.395632 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e12dc6ba-88e4-4947-9aaa-81df43ba45e9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:11.399145 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-07dd19bf-9239-4999-871b-3d681dc9f1b6 req-fd0828fa-4dc2-4b5b-872b-3536e804d569 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033278 Sep 01 15:03:11.400399 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 276/556] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:03:11.532697 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e12dc6ba-88e4-4947-9aaa-81df43ba45e9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:11.542964 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e12dc6ba-88e4-4947-9aaa-81df43ba45e9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.162990 Sep 01 15:03:11.543517 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 281/557] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:11 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:12.354223 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:12.354949 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:12.361109 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:12.361596 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:12.362096 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:12.362817 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:12.363278 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:12.363713 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:12.497458 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:12.505879 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:12.507445 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:12.508597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b591720c-c2c3-44c0-85ad-ab7eb64228ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1598 microversion: 2.20 time: 0.159241 Sep 01 15:03:12.509157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 277/558] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:12 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:12.530264 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9772f005-a164-4966-b232-1484768c519c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:12.530801 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9772f005-a164-4966-b232-1484768c519c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:12.537202 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9772f005-a164-4966-b232-1484768c519c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:12.537687 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9772f005-a164-4966-b232-1484768c519c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:12.538126 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9772f005-a164-4966-b232-1484768c519c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:12.539533 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9772f005-a164-4966-b232-1484768c519c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:12.539922 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9772f005-a164-4966-b232-1484768c519c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:12.540349 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9772f005-a164-4966-b232-1484768c519c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:12.563236 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6d5d7349-7575-4ad1-a9a4-6314a7fbcc2d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:12.563854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6d5d7349-7575-4ad1-a9a4-6314a7fbcc2d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:12.569870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d5d7349-7575-4ad1-a9a4-6314a7fbcc2d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:12.570391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d5d7349-7575-4ad1-a9a4-6314a7fbcc2d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:12.570910 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d5d7349-7575-4ad1-a9a4-6314a7fbcc2d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:12.571611 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d5d7349-7575-4ad1-a9a4-6314a7fbcc2d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:12.572072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d5d7349-7575-4ad1-a9a4-6314a7fbcc2d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:12.572500 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6d5d7349-7575-4ad1-a9a4-6314a7fbcc2d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:12.616536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9772f005-a164-4966-b232-1484768c519c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090072 Sep 01 15:03:12.617191 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 282/559] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Sep 1 15:03:12 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 15:03:12.705834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6d5d7349-7575-4ad1-a9a4-6314a7fbcc2d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:12.714349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6d5d7349-7575-4ad1-a9a4-6314a7fbcc2d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.154857 Sep 01 15:03:12.714918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 278/560] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:12 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:13.541280 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-c3bb1d1b-5e50-423c-84dd-3972d69b0b1e req-2968ecc3-c48d-41c8-b888-54879e1790af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ea0e09a-fcb0-4aab-844d-c9b7d170ec95", "tag": "2c6c7ac6-7b01-495d-911b-2cf5b78b8904"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:13.550783 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-c3bb1d1b-5e50-423c-84dd-3972d69b0b1e req-2968ecc3-c48d-41c8-b888-54879e1790af service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:13.551270 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-c3bb1d1b-5e50-423c-84dd-3972d69b0b1e req-2968ecc3-c48d-41c8-b888-54879e1790af service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:13.551713 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-c3bb1d1b-5e50-423c-84dd-3972d69b0b1e req-2968ecc3-c48d-41c8-b888-54879e1790af service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:13.562705 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-c3bb1d1b-5e50-423c-84dd-3972d69b0b1e req-2968ecc3-c48d-41c8-b888-54879e1790af service nova] Creating event network-changed:2c6c7ac6-7b01-495d-911b-2cf5b78b8904 for instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 on hv-cinder-85505 Sep 01 15:03:13.567548 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-c3bb1d1b-5e50-423c-84dd-3972d69b0b1e req-2968ecc3-c48d-41c8-b888-54879e1790af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031142 Sep 01 15:03:13.568154 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 283/561] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:03:13.735270 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-abe5d21e-0f04-4834-953e-f2ae025cfef1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:13.735892 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-abe5d21e-0f04-4834-953e-f2ae025cfef1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:13.742038 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abe5d21e-0f04-4834-953e-f2ae025cfef1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:13.742547 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abe5d21e-0f04-4834-953e-f2ae025cfef1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:13.742983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abe5d21e-0f04-4834-953e-f2ae025cfef1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:13.743679 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abe5d21e-0f04-4834-953e-f2ae025cfef1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:13.744134 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abe5d21e-0f04-4834-953e-f2ae025cfef1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:13.744555 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abe5d21e-0f04-4834-953e-f2ae025cfef1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:13.887588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-abe5d21e-0f04-4834-953e-f2ae025cfef1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:13.895753 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-abe5d21e-0f04-4834-953e-f2ae025cfef1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.164125 Sep 01 15:03:13.896654 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 279/562] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:13 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:14.919833 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9d9d7949-7fb9-4c64-beab-97bd71cd61ce tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:14.920587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9d9d7949-7fb9-4c64-beab-97bd71cd61ce tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:14.927015 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9d9d7949-7fb9-4c64-beab-97bd71cd61ce tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:14.927501 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9d9d7949-7fb9-4c64-beab-97bd71cd61ce tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:14.927947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9d9d7949-7fb9-4c64-beab-97bd71cd61ce tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:14.928644 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9d9d7949-7fb9-4c64-beab-97bd71cd61ce tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:14.929586 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9d9d7949-7fb9-4c64-beab-97bd71cd61ce tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:14.930026 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9d9d7949-7fb9-4c64-beab-97bd71cd61ce tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:15.064089 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9d9d7949-7fb9-4c64-beab-97bd71cd61ce tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:15.072515 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9d9d7949-7fb9-4c64-beab-97bd71cd61ce tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.157577 Sep 01 15:03:15.073067 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 284/563] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:14 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:16.092639 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-cb6d64e4-ebe3-46c6-b1b4-f096a10ffbc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:16.093256 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-cb6d64e4-ebe3-46c6-b1b4-f096a10ffbc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:16.095860 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:16.096637 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=6 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:16.102354 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cb6d64e4-ebe3-46c6-b1b4-f096a10ffbc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:16.102842 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cb6d64e4-ebe3-46c6-b1b4-f096a10ffbc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:16.103284 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cb6d64e4-ebe3-46c6-b1b4-f096a10ffbc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:16.103974 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cb6d64e4-ebe3-46c6-b1b4-f096a10ffbc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:16.104433 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cb6d64e4-ebe3-46c6-b1b4-f096a10ffbc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:16.104862 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cb6d64e4-ebe3-46c6-b1b4-f096a10ffbc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:16.235538 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-cb6d64e4-ebe3-46c6-b1b4-f096a10ffbc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:16.243652 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-cb6d64e4-ebe3-46c6-b1b4-f096a10ffbc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.154912 Sep 01 15:03:16.244205 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 280/564] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:16 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:17.264267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9dcc4e48-485e-4e0d-b1d6-3bb3c1a12c15 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:17.264812 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9dcc4e48-485e-4e0d-b1d6-3bb3c1a12c15 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:17.266789 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:17.272484 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9dcc4e48-485e-4e0d-b1d6-3bb3c1a12c15 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:17.273539 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9dcc4e48-485e-4e0d-b1d6-3bb3c1a12c15 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:17.273994 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9dcc4e48-485e-4e0d-b1d6-3bb3c1a12c15 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:17.274691 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9dcc4e48-485e-4e0d-b1d6-3bb3c1a12c15 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:17.275147 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9dcc4e48-485e-4e0d-b1d6-3bb3c1a12c15 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:17.275569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9dcc4e48-485e-4e0d-b1d6-3bb3c1a12c15 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:17.402737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9dcc4e48-485e-4e0d-b1d6-3bb3c1a12c15 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:17.410309 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9dcc4e48-485e-4e0d-b1d6-3bb3c1a12c15 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.149969 Sep 01 15:03:17.410866 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 285/565] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:17 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:18.431013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5d5bcdec-c12b-4206-a758-89f98d5bf5fa tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:18.431631 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5d5bcdec-c12b-4206-a758-89f98d5bf5fa tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:18.433956 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:18.439116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d5bcdec-c12b-4206-a758-89f98d5bf5fa tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:18.439603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d5bcdec-c12b-4206-a758-89f98d5bf5fa tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:18.440041 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d5bcdec-c12b-4206-a758-89f98d5bf5fa tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:18.440733 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d5bcdec-c12b-4206-a758-89f98d5bf5fa tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:18.441190 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d5bcdec-c12b-4206-a758-89f98d5bf5fa tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:18.441617 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d5bcdec-c12b-4206-a758-89f98d5bf5fa tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:18.570820 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-5d5bcdec-c12b-4206-a758-89f98d5bf5fa tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:18.578505 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5d5bcdec-c12b-4206-a758-89f98d5bf5fa tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.151972 Sep 01 15:03:18.579065 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 281/566] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:18 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:19.599145 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-16051416-cf12-45b9-9423-9a97fa6cf767 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:19.599755 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-16051416-cf12-45b9-9423-9a97fa6cf767 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:19.602631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:19.608487 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16051416-cf12-45b9-9423-9a97fa6cf767 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:19.608967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16051416-cf12-45b9-9423-9a97fa6cf767 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:19.609400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16051416-cf12-45b9-9423-9a97fa6cf767 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:19.610078 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16051416-cf12-45b9-9423-9a97fa6cf767 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:19.610564 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16051416-cf12-45b9-9423-9a97fa6cf767 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:19.610992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16051416-cf12-45b9-9423-9a97fa6cf767 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:19.748283 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-16051416-cf12-45b9-9423-9a97fa6cf767 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:19.756111 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-16051416-cf12-45b9-9423-9a97fa6cf767 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.160853 Sep 01 15:03:19.756667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 286/567] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:19 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:20.779249 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f2241ffe-0b2e-46ea-b5e1-796de8b4db99 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:20.779866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f2241ffe-0b2e-46ea-b5e1-796de8b4db99 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:20.785888 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2241ffe-0b2e-46ea-b5e1-796de8b4db99 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:20.786423 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2241ffe-0b2e-46ea-b5e1-796de8b4db99 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:20.786863 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2241ffe-0b2e-46ea-b5e1-796de8b4db99 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:20.787560 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2241ffe-0b2e-46ea-b5e1-796de8b4db99 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:20.788020 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2241ffe-0b2e-46ea-b5e1-796de8b4db99 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:20.788450 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2241ffe-0b2e-46ea-b5e1-796de8b4db99 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:20.921736 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f2241ffe-0b2e-46ea-b5e1-796de8b4db99 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:20.929895 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f2241ffe-0b2e-46ea-b5e1-796de8b4db99 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.154497 Sep 01 15:03:20.930491 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 282/568] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:20 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:21.950095 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e56fc5d2-6a82-4e6c-9c09-43bb4235a750 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:21.950778 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e56fc5d2-6a82-4e6c-9c09-43bb4235a750 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:21.957181 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e56fc5d2-6a82-4e6c-9c09-43bb4235a750 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:21.957675 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e56fc5d2-6a82-4e6c-9c09-43bb4235a750 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:21.958118 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e56fc5d2-6a82-4e6c-9c09-43bb4235a750 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:21.958847 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e56fc5d2-6a82-4e6c-9c09-43bb4235a750 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:21.959414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e56fc5d2-6a82-4e6c-9c09-43bb4235a750 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:21.959978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e56fc5d2-6a82-4e6c-9c09-43bb4235a750 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:22.105483 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e56fc5d2-6a82-4e6c-9c09-43bb4235a750 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:22.113427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e56fc5d2-6a82-4e6c-9c09-43bb4235a750 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.167231 Sep 01 15:03:22.114077 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 287/569] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:21 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:22.942503 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-f3bb2e90-e000-4dc3-8c58-989f77aff7d2 req-c0226b82-ab57-4808-b693-ebc0d81194af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4561748-1530-48b0-b782-1bceb2ecb240", "name": "network-vif-plugged", "status": "completed", "tag": "9df92666-196a-402d-a511-48632bf3326d"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:22.966206 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-f3bb2e90-e000-4dc3-8c58-989f77aff7d2 req-c0226b82-ab57-4808-b693-ebc0d81194af service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:22.966791 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-f3bb2e90-e000-4dc3-8c58-989f77aff7d2 req-c0226b82-ab57-4808-b693-ebc0d81194af service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:22.970841 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-f3bb2e90-e000-4dc3-8c58-989f77aff7d2 req-c0226b82-ab57-4808-b693-ebc0d81194af service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:22.984761 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-f3bb2e90-e000-4dc3-8c58-989f77aff7d2 req-c0226b82-ab57-4808-b693-ebc0d81194af service nova] Creating event network-vif-plugged:9df92666-196a-402d-a511-48632bf3326d for instance e4561748-1530-48b0-b782-1bceb2ecb240 on hv-cinder-85505 Sep 01 15:03:22.990640 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-f3bb2e90-e000-4dc3-8c58-989f77aff7d2 req-c0226b82-ab57-4808-b693-ebc0d81194af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052071 Sep 01 15:03:22.991476 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 283/570] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:03:23.134610 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-afd2f41b-870c-49b2-ac36-18c883e4e02c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:23.135796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-afd2f41b-870c-49b2-ac36-18c883e4e02c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:23.153021 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-afd2f41b-870c-49b2-ac36-18c883e4e02c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:23.154204 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-afd2f41b-870c-49b2-ac36-18c883e4e02c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:23.156486 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-afd2f41b-870c-49b2-ac36-18c883e4e02c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:23.162701 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-afd2f41b-870c-49b2-ac36-18c883e4e02c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:23.163413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-afd2f41b-870c-49b2-ac36-18c883e4e02c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:23.163914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-afd2f41b-870c-49b2-ac36-18c883e4e02c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:23.384034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-afd2f41b-870c-49b2-ac36-18c883e4e02c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:23.392132 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-afd2f41b-870c-49b2-ac36-18c883e4e02c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.262140 Sep 01 15:03:23.392688 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 288/571] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:23 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:24.414545 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-77131cd4-a32d-4079-8289-9088c0f57fd6 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:24.415851 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-77131cd4-a32d-4079-8289-9088c0f57fd6 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:24.422858 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77131cd4-a32d-4079-8289-9088c0f57fd6 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:24.423514 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77131cd4-a32d-4079-8289-9088c0f57fd6 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:24.424189 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77131cd4-a32d-4079-8289-9088c0f57fd6 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:24.424911 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77131cd4-a32d-4079-8289-9088c0f57fd6 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:24.425363 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77131cd4-a32d-4079-8289-9088c0f57fd6 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:24.425795 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-77131cd4-a32d-4079-8289-9088c0f57fd6 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:24.974538 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-77131cd4-a32d-4079-8289-9088c0f57fd6 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:24.985136 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-77131cd4-a32d-4079-8289-9088c0f57fd6 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1264 microversion: 2.1 time: 0.574730 Sep 01 15:03:24.985708 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 284/572] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:24 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1264 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:26.005488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-3cd3ff89-7429-4dc7-8bca-93d76d018dc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:26.006818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-3cd3ff89-7429-4dc7-8bca-93d76d018dc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:26.015757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3cd3ff89-7429-4dc7-8bca-93d76d018dc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:26.016419 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3cd3ff89-7429-4dc7-8bca-93d76d018dc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:26.017023 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3cd3ff89-7429-4dc7-8bca-93d76d018dc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:26.017923 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3cd3ff89-7429-4dc7-8bca-93d76d018dc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:26.018892 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3cd3ff89-7429-4dc7-8bca-93d76d018dc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:26.019680 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3cd3ff89-7429-4dc7-8bca-93d76d018dc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:26.279605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-3cd3ff89-7429-4dc7-8bca-93d76d018dc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:26.288373 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-3cd3ff89-7429-4dc7-8bca-93d76d018dc2 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1452 microversion: 2.1 time: 0.286699 Sep 01 15:03:26.289362 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 289/573] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:26 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1452 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:26.375793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4ff9a8e0-66b7-4e95-b802-5555e55f8bbd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:26.376582 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4ff9a8e0-66b7-4e95-b802-5555e55f8bbd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:26.382841 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ff9a8e0-66b7-4e95-b802-5555e55f8bbd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:26.384020 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ff9a8e0-66b7-4e95-b802-5555e55f8bbd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:26.384740 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ff9a8e0-66b7-4e95-b802-5555e55f8bbd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:26.385594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ff9a8e0-66b7-4e95-b802-5555e55f8bbd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:26.386334 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ff9a8e0-66b7-4e95-b802-5555e55f8bbd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:26.386918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4ff9a8e0-66b7-4e95-b802-5555e55f8bbd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:26.661540 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4ff9a8e0-66b7-4e95-b802-5555e55f8bbd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:26.671290 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4ff9a8e0-66b7-4e95-b802-5555e55f8bbd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1452 microversion: 2.1 time: 0.300913 Sep 01 15:03:26.678847 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 285/574] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:26 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1452 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:28.809096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-a37d0b01-011c-4bd4-9f5d-08ec868352de req-985cdd62-94c6-4e8f-b5e5-9e5a400a7922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4561748-1530-48b0-b782-1bceb2ecb240", "tag": "9df92666-196a-402d-a511-48632bf3326d"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:28.821496 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-a37d0b01-011c-4bd4-9f5d-08ec868352de req-985cdd62-94c6-4e8f-b5e5-9e5a400a7922 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:28.821991 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-a37d0b01-011c-4bd4-9f5d-08ec868352de req-985cdd62-94c6-4e8f-b5e5-9e5a400a7922 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:28.822472 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-a37d0b01-011c-4bd4-9f5d-08ec868352de req-985cdd62-94c6-4e8f-b5e5-9e5a400a7922 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:28.835850 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-a37d0b01-011c-4bd4-9f5d-08ec868352de req-985cdd62-94c6-4e8f-b5e5-9e5a400a7922 service nova] Creating event network-changed:9df92666-196a-402d-a511-48632bf3326d for instance e4561748-1530-48b0-b782-1bceb2ecb240 on hv-cinder-85505 Sep 01 15:03:28.842292 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-a37d0b01-011c-4bd4-9f5d-08ec868352de req-985cdd62-94c6-4e8f-b5e5-9e5a400a7922 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038957 Sep 01 15:03:28.843154 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 290/575] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:03:32.677480 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1ebb310b-ff42-49d7-ab32-3964ed15d7ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:32.678780 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1ebb310b-ff42-49d7-ab32-3964ed15d7ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:32.686830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1ebb310b-ff42-49d7-ab32-3964ed15d7ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:32.687600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1ebb310b-ff42-49d7-ab32-3964ed15d7ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:32.688236 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1ebb310b-ff42-49d7-ab32-3964ed15d7ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:32.689130 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1ebb310b-ff42-49d7-ab32-3964ed15d7ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:32.689764 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1ebb310b-ff42-49d7-ab32-3964ed15d7ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:32.690618 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1ebb310b-ff42-49d7-ab32-3964ed15d7ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:32.773000 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3e0330a1-5b08-4f5d-9db0-e6d1ccbb1d79 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Action: 'create', calling method: .version_select at 0x7fab73ea5430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1044275487", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLok2EHKluHE99fU8/ZpZQjH1bpwR3qzSpmOoTe/Nm9oMVi3NA/Pxe4R8pXo0Z4xy2l/Op2Myl8HiUBoN74eo4Xch6i01/B8gZ5oz4PBdr1snZUyCad3KEjnwxU1zZlYQ=="}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:32.789712 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-3e0330a1-5b08-4f5d-9db0-e6d1ccbb1d79 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Getting quotas for project 764329f7a06b42969616baffd95cbd29. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:03:32.792750 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-1ebb310b-ff42-49d7-ab32-3964ed15d7ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lazy-loading 'services' on Instance uuid da903e65-d948-457a-8d12-9253ffeacb02 {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:03:32.800740 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-3e0330a1-5b08-4f5d-9db0-e6d1ccbb1d79 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Getting quotas for user 210bc3fc36724b32ba50364332c6f900 and project 764329f7a06b42969616baffd95cbd29. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:03:32.828801 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3e0330a1-5b08-4f5d-9db0-e6d1ccbb1d79 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.282569 Sep 01 15:03:32.830059 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 286/576] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 1 15:03:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:03:32.892670 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1ebb310b-ff42-49d7-ab32-3964ed15d7ec tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "DELETE /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-volume_attachments/e84390ab-9f50-4c59-a109-12cccaf74b61" status: 202 len: 0 microversion: 2.1 time: 0.220439 Sep 01 15:03:32.898158 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 291/577] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:03:32 2022] DELETE /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-volume_attachments/e84390ab-9f50-4c59-a109-12cccaf74b61 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:03:32.904522 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f2204913-f2f0-405e-b8d4-019cd612c35d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:32.907922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f2204913-f2f0-405e-b8d4-019cd612c35d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:32.916474 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2204913-f2f0-405e-b8d4-019cd612c35d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:32.917173 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2204913-f2f0-405e-b8d4-019cd612c35d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:32.917778 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2204913-f2f0-405e-b8d4-019cd612c35d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:32.918831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2204913-f2f0-405e-b8d4-019cd612c35d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:32.919438 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2204913-f2f0-405e-b8d4-019cd612c35d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:32.920022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2204913-f2f0-405e-b8d4-019cd612c35d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:32.962071 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f2204913-f2f0-405e-b8d4-019cd612c35d tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062503 Sep 01 15:03:32.967072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 287/578] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:03:32 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:03:33.975707 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ce834448-dea8-4fff-9da4-95b54b46eb67 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:33.978123 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ce834448-dea8-4fff-9da4-95b54b46eb67 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:33.984963 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce834448-dea8-4fff-9da4-95b54b46eb67 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:33.985451 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce834448-dea8-4fff-9da4-95b54b46eb67 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:33.985889 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce834448-dea8-4fff-9da4-95b54b46eb67 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:33.986627 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce834448-dea8-4fff-9da4-95b54b46eb67 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:33.987091 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce834448-dea8-4fff-9da4-95b54b46eb67 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:33.987523 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce834448-dea8-4fff-9da4-95b54b46eb67 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:34.018177 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ce834448-dea8-4fff-9da4-95b54b46eb67 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047146 Sep 01 15:03:34.019631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 292/579] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:03:33 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 15:03:34.095195 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-80d999c7-43f4-46e8-86f5-7e3b559e8d2f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:34.096289 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-80d999c7-43f4-46e8-86f5-7e3b559e8d2f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:34.107206 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80d999c7-43f4-46e8-86f5-7e3b559e8d2f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:34.107968 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80d999c7-43f4-46e8-86f5-7e3b559e8d2f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:34.108473 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80d999c7-43f4-46e8-86f5-7e3b559e8d2f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:34.109243 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80d999c7-43f4-46e8-86f5-7e3b559e8d2f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:34.110797 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80d999c7-43f4-46e8-86f5-7e3b559e8d2f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:34.111605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80d999c7-43f4-46e8-86f5-7e3b559e8d2f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:34.130818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2061b713-fa21-4d75-a56c-290abfb4d542 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:34.133146 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2061b713-fa21-4d75-a56c-290abfb4d542 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:34.139743 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2061b713-fa21-4d75-a56c-290abfb4d542 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:34.140458 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2061b713-fa21-4d75-a56c-290abfb4d542 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:34.141059 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2061b713-fa21-4d75-a56c-290abfb4d542 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:34.141937 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2061b713-fa21-4d75-a56c-290abfb4d542 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:34.142578 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2061b713-fa21-4d75-a56c-290abfb4d542 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:34.143456 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2061b713-fa21-4d75-a56c-290abfb4d542 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:34.144973 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-80d999c7-43f4-46e8-86f5-7e3b559e8d2f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:03:34.164851 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:34.179828 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=100 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:34.183554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2061b713-fa21-4d75-a56c-290abfb4d542 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056583 Sep 01 15:03:34.184480 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 293/580] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:03:34 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 15:03:34.265443 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-80d999c7-43f4-46e8-86f5-7e3b559e8d2f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "DELETE /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 204 len: 0 microversion: 2.1 time: 0.174291 Sep 01 15:03:34.266634 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 288/581] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:03:34 2022] DELETE /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:03:34.276462 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-83c6f2bc-6a51-4e31-895c-491244724e86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:34.277140 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-83c6f2bc-6a51-4e31-895c-491244724e86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:34.278968 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-83134443-bdb5-4cc4-aa26-5de1801fb5c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:34.279929 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-83134443-bdb5-4cc4-aa26-5de1801fb5c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:34.286749 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83c6f2bc-6a51-4e31-895c-491244724e86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:34.287445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83c6f2bc-6a51-4e31-895c-491244724e86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:34.287889 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83c6f2bc-6a51-4e31-895c-491244724e86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:34.288586 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83c6f2bc-6a51-4e31-895c-491244724e86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:34.288800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-83134443-bdb5-4cc4-aa26-5de1801fb5c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:34.289146 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83c6f2bc-6a51-4e31-895c-491244724e86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:34.289510 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-83134443-bdb5-4cc4-aa26-5de1801fb5c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:34.289685 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83c6f2bc-6a51-4e31-895c-491244724e86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:34.290035 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-83134443-bdb5-4cc4-aa26-5de1801fb5c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:34.291347 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-83134443-bdb5-4cc4-aa26-5de1801fb5c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:34.291874 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-83134443-bdb5-4cc4-aa26-5de1801fb5c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:34.292272 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-83134443-bdb5-4cc4-aa26-5de1801fb5c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:34.330155 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-83c6f2bc-6a51-4e31-895c-491244724e86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Going to try to terminate instance {{(pid=120553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:03:34.435810 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-83c6f2bc-6a51-4e31-895c-491244724e86 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 204 len: 0 microversion: 2.1 time: 0.163985 Sep 01 15:03:34.436778 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 294/582] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:03:34 2022] DELETE /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:03:34.458331 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c3bab116-21e5-4bb2-9ae7-3e63fb2d9194 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:34.459375 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c3bab116-21e5-4bb2-9ae7-3e63fb2d9194 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:34.470145 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c3bab116-21e5-4bb2-9ae7-3e63fb2d9194 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:34.470957 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c3bab116-21e5-4bb2-9ae7-3e63fb2d9194 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:34.471642 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c3bab116-21e5-4bb2-9ae7-3e63fb2d9194 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:34.472588 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c3bab116-21e5-4bb2-9ae7-3e63fb2d9194 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:34.473161 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c3bab116-21e5-4bb2-9ae7-3e63fb2d9194 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:34.473859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c3bab116-21e5-4bb2-9ae7-3e63fb2d9194 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:34.488568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-83134443-bdb5-4cc4-aa26-5de1801fb5c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:34.497431 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-83134443-bdb5-4cc4-aa26-5de1801fb5c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1689 microversion: 2.1 time: 0.223086 Sep 01 15:03:34.498467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 289/583] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:34 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:34.618843 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c3bab116-21e5-4bb2-9ae7-3e63fb2d9194 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:34.626697 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c3bab116-21e5-4bb2-9ae7-3e63fb2d9194 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1675 microversion: 2.1 time: 0.174892 Sep 01 15:03:34.627348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 295/584] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:34 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:35.523786 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-545f16c7-007b-496c-a46c-78a7402f412f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:35.525116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-545f16c7-007b-496c-a46c-78a7402f412f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:35.531837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-545f16c7-007b-496c-a46c-78a7402f412f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:35.532433 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-545f16c7-007b-496c-a46c-78a7402f412f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:35.533089 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-545f16c7-007b-496c-a46c-78a7402f412f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:35.533948 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-545f16c7-007b-496c-a46c-78a7402f412f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:35.534571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-545f16c7-007b-496c-a46c-78a7402f412f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:35.535007 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-545f16c7-007b-496c-a46c-78a7402f412f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:35.648832 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-10583020-e33b-46b7-ba84-e0f12388c6cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:35.650676 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-10583020-e33b-46b7-ba84-e0f12388c6cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:35.658875 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-10583020-e33b-46b7-ba84-e0f12388c6cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:35.659792 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-10583020-e33b-46b7-ba84-e0f12388c6cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:35.660482 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-10583020-e33b-46b7-ba84-e0f12388c6cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:35.661461 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-10583020-e33b-46b7-ba84-e0f12388c6cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:35.662167 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-10583020-e33b-46b7-ba84-e0f12388c6cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:35.662871 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-10583020-e33b-46b7-ba84-e0f12388c6cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:35.686072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-545f16c7-007b-496c-a46c-78a7402f412f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:35.695567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-545f16c7-007b-496c-a46c-78a7402f412f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1689 microversion: 2.1 time: 0.175786 Sep 01 15:03:35.696489 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 290/585] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:35 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:35.805424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-10583020-e33b-46b7-ba84-e0f12388c6cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:35.814054 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-10583020-e33b-46b7-ba84-e0f12388c6cb tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1675 microversion: 2.1 time: 0.169229 Sep 01 15:03:35.814705 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 296/586] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:35 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:36.814826 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2b1a8819-1b1c-48f2-af5b-4235b5c28800 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:36.815662 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2b1a8819-1b1c-48f2-af5b-4235b5c28800 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:36.822404 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b1a8819-1b1c-48f2-af5b-4235b5c28800 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:36.822896 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b1a8819-1b1c-48f2-af5b-4235b5c28800 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:36.823337 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b1a8819-1b1c-48f2-af5b-4235b5c28800 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:36.824038 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b1a8819-1b1c-48f2-af5b-4235b5c28800 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:36.824497 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b1a8819-1b1c-48f2-af5b-4235b5c28800 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:36.824926 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2b1a8819-1b1c-48f2-af5b-4235b5c28800 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:36.835193 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-416935e8-db64-4e1c-ab04-b1a9af8c32b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:36.835809 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-416935e8-db64-4e1c-ab04-b1a9af8c32b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:36.842903 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-416935e8-db64-4e1c-ab04-b1a9af8c32b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:36.843424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-416935e8-db64-4e1c-ab04-b1a9af8c32b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:36.843866 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-416935e8-db64-4e1c-ab04-b1a9af8c32b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:36.844553 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-416935e8-db64-4e1c-ab04-b1a9af8c32b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:36.845008 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-416935e8-db64-4e1c-ab04-b1a9af8c32b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:36.845431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-416935e8-db64-4e1c-ab04-b1a9af8c32b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:36.965892 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2b1a8819-1b1c-48f2-af5b-4235b5c28800 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:36.973958 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2b1a8819-1b1c-48f2-af5b-4235b5c28800 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1689 microversion: 2.1 time: 0.260350 Sep 01 15:03:36.974583 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 291/587] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:36 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1689 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:36.984153 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-416935e8-db64-4e1c-ab04-b1a9af8c32b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:36.992115 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-416935e8-db64-4e1c-ab04-b1a9af8c32b5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1675 microversion: 2.1 time: 0.160810 Sep 01 15:03:36.993290 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 297/588] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:36 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:37.994624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0c42bd5d-acba-4456-a78f-1743cc9a8688 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:37.995271 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0c42bd5d-acba-4456-a78f-1743cc9a8688 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:38.001625 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c42bd5d-acba-4456-a78f-1743cc9a8688 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:38.002110 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c42bd5d-acba-4456-a78f-1743cc9a8688 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:38.002607 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c42bd5d-acba-4456-a78f-1743cc9a8688 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:38.003304 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c42bd5d-acba-4456-a78f-1743cc9a8688 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:38.003849 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c42bd5d-acba-4456-a78f-1743cc9a8688 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:38.004278 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0c42bd5d-acba-4456-a78f-1743cc9a8688 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:38.126024 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1581b34b-3b8d-452b-9754-9441d5127ee8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:38.126675 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1581b34b-3b8d-452b-9754-9441d5127ee8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:38.132519 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1581b34b-3b8d-452b-9754-9441d5127ee8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:38.133009 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1581b34b-3b8d-452b-9754-9441d5127ee8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:38.133449 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1581b34b-3b8d-452b-9754-9441d5127ee8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:38.134193 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1581b34b-3b8d-452b-9754-9441d5127ee8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:38.134725 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1581b34b-3b8d-452b-9754-9441d5127ee8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:38.135156 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1581b34b-3b8d-452b-9754-9441d5127ee8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:38.142610 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0c42bd5d-acba-4456-a78f-1743cc9a8688 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:38.152005 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0c42bd5d-acba-4456-a78f-1743cc9a8688 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1689 microversion: 2.1 time: 0.161264 Sep 01 15:03:38.152592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 292/589] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:37 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:38.267726 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1581b34b-3b8d-452b-9754-9441d5127ee8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:38.276014 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1581b34b-3b8d-452b-9754-9441d5127ee8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1675 microversion: 2.1 time: 0.265846 Sep 01 15:03:38.276784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 298/590] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:38 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1675 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:39.173151 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ba93044d-57c3-4b58-8350-be3ac3493ee9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:39.173769 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ba93044d-57c3-4b58-8350-be3ac3493ee9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:39.180508 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba93044d-57c3-4b58-8350-be3ac3493ee9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:39.181724 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba93044d-57c3-4b58-8350-be3ac3493ee9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:39.182186 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba93044d-57c3-4b58-8350-be3ac3493ee9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:39.182945 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba93044d-57c3-4b58-8350-be3ac3493ee9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:39.183417 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba93044d-57c3-4b58-8350-be3ac3493ee9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:39.183850 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ba93044d-57c3-4b58-8350-be3ac3493ee9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:39.297069 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4cf140d6-d08e-49ea-8968-dc0db211b1d2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:39.297644 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4cf140d6-d08e-49ea-8968-dc0db211b1d2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:39.304974 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4cf140d6-d08e-49ea-8968-dc0db211b1d2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:39.305477 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4cf140d6-d08e-49ea-8968-dc0db211b1d2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:39.305941 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4cf140d6-d08e-49ea-8968-dc0db211b1d2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:39.307225 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4cf140d6-d08e-49ea-8968-dc0db211b1d2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:39.307706 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4cf140d6-d08e-49ea-8968-dc0db211b1d2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:39.308137 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4cf140d6-d08e-49ea-8968-dc0db211b1d2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:39.317902 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ba93044d-57c3-4b58-8350-be3ac3493ee9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:39.325696 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ba93044d-57c3-4b58-8350-be3ac3493ee9 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1689 microversion: 2.1 time: 0.156648 Sep 01 15:03:39.326266 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 293/591] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:39 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:39.444251 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4cf140d6-d08e-49ea-8968-dc0db211b1d2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:39.452498 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4cf140d6-d08e-49ea-8968-dc0db211b1d2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1675 microversion: 2.1 time: 0.159358 Sep 01 15:03:39.453072 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 299/592] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:39 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:40.347450 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-decdb25d-7f50-40d9-b09b-32159593aa05 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:40.348062 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-decdb25d-7f50-40d9-b09b-32159593aa05 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:40.354501 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-decdb25d-7f50-40d9-b09b-32159593aa05 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:40.354989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-decdb25d-7f50-40d9-b09b-32159593aa05 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:40.355425 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-decdb25d-7f50-40d9-b09b-32159593aa05 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:40.356111 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-decdb25d-7f50-40d9-b09b-32159593aa05 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:40.356570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-decdb25d-7f50-40d9-b09b-32159593aa05 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:40.356998 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-decdb25d-7f50-40d9-b09b-32159593aa05 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:40.473880 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-16df0941-3076-419d-9ce5-9bd99185e8c9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:40.474585 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-16df0941-3076-419d-9ce5-9bd99185e8c9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:40.481467 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16df0941-3076-419d-9ce5-9bd99185e8c9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:40.481965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16df0941-3076-419d-9ce5-9bd99185e8c9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:40.482444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16df0941-3076-419d-9ce5-9bd99185e8c9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:40.483158 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16df0941-3076-419d-9ce5-9bd99185e8c9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:40.484149 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16df0941-3076-419d-9ce5-9bd99185e8c9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:40.485483 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-16df0941-3076-419d-9ce5-9bd99185e8c9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:40.531173 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-decdb25d-7f50-40d9-b09b-32159593aa05 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:40.541286 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-decdb25d-7f50-40d9-b09b-32159593aa05 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1689 microversion: 2.1 time: 0.197114 Sep 01 15:03:40.542376 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 294/593] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:40 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:40.712537 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-16df0941-3076-419d-9ce5-9bd99185e8c9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:40.727657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-16df0941-3076-419d-9ce5-9bd99185e8c9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1675 microversion: 2.1 time: 0.257570 Sep 01 15:03:40.741029 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 300/594] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:40 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1675 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:41.392490 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-b881006a-6adc-4a61-8a41-310eda6e2444 req-44f13dd7-2319-4aa7-8834-5b4e046cbf5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1140cc-9fea-4464-8b9b-80db1ba7afd0", "name": "network-vif-deleted", "tag": "7238e964-74aa-48ea-91ba-e00ada9441ab"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:41.411832 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b881006a-6adc-4a61-8a41-310eda6e2444 req-44f13dd7-2319-4aa7-8834-5b4e046cbf5b service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:41.412631 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b881006a-6adc-4a61-8a41-310eda6e2444 req-44f13dd7-2319-4aa7-8834-5b4e046cbf5b service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:41.413260 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b881006a-6adc-4a61-8a41-310eda6e2444 req-44f13dd7-2319-4aa7-8834-5b4e046cbf5b service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:41.429968 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-b881006a-6adc-4a61-8a41-310eda6e2444 req-44f13dd7-2319-4aa7-8834-5b4e046cbf5b service nova] Creating event network-vif-deleted:7238e964-74aa-48ea-91ba-e00ada9441ab for instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 on hv-cinder-85505 Sep 01 15:03:41.436944 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-b881006a-6adc-4a61-8a41-310eda6e2444 req-44f13dd7-2319-4aa7-8834-5b4e046cbf5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047967 Sep 01 15:03:41.437546 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 295/595] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:03:41.564318 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d1618ae0-a6ef-4f17-acbd-118c4f0bc263 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:41.565099 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d1618ae0-a6ef-4f17-acbd-118c4f0bc263 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:41.572297 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1618ae0-a6ef-4f17-acbd-118c4f0bc263 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:41.573409 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1618ae0-a6ef-4f17-acbd-118c4f0bc263 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:41.574130 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1618ae0-a6ef-4f17-acbd-118c4f0bc263 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:41.575101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1618ae0-a6ef-4f17-acbd-118c4f0bc263 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:41.575772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1618ae0-a6ef-4f17-acbd-118c4f0bc263 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:41.576437 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d1618ae0-a6ef-4f17-acbd-118c4f0bc263 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:41.749588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:41.750985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:41.764675 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:41.765423 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:41.766062 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:41.769374 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:41.770136 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:41.770885 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:41.820165 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:41.821049 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:41.821700 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:41.822517 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.objects.instance [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lazy-loading 'fault' on Instance uuid 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 {{(pid=120554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:03:41.896586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:41.908192 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-fb4e1abb-2228-40ac-9f8e-13df3d7c131d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 200 len: 1328 microversion: 2.1 time: 0.162793 Sep 01 15:03:41.908780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 296/596] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:41 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 1328 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:41.976288 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d1618ae0-a6ef-4f17-acbd-118c4f0bc263 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:41.986007 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d1618ae0-a6ef-4f17-acbd-118c4f0bc263 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1689 microversion: 2.1 time: 0.425831 Sep 01 15:03:41.992546 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 301/597] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:41 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1689 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:42.219922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-9c123ad2-3c91-4032-abc5-e0a30f31f8c4 req-3e120f59-48f0-45db-93e0-210d448f4f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da903e65-d948-457a-8d12-9253ffeacb02", "name": "network-vif-deleted", "tag": "c6295804-bbdf-4e7a-af58-cedd94bf76a7"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:42.243860 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-9c123ad2-3c91-4032-abc5-e0a30f31f8c4 req-3e120f59-48f0-45db-93e0-210d448f4f1e service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:42.264177 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-9c123ad2-3c91-4032-abc5-e0a30f31f8c4 req-3e120f59-48f0-45db-93e0-210d448f4f1e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:42.264639 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-9c123ad2-3c91-4032-abc5-e0a30f31f8c4 req-3e120f59-48f0-45db-93e0-210d448f4f1e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:42.312496 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-9c123ad2-3c91-4032-abc5-e0a30f31f8c4 req-3e120f59-48f0-45db-93e0-210d448f4f1e service nova] Creating event network-vif-deleted:c6295804-bbdf-4e7a-af58-cedd94bf76a7 for instance da903e65-d948-457a-8d12-9253ffeacb02 on hv-cinder-85505 Sep 01 15:03:42.326479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-9c123ad2-3c91-4032-abc5-e0a30f31f8c4 req-3e120f59-48f0-45db-93e0-210d448f4f1e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118023 Sep 01 15:03:42.328654 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 297/598] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:03:42.933434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:42.938925 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:42.950791 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:42.951286 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:42.951773 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:42.952686 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:42.953146 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:42.953574 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:42.973658 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] HTTP exception thrown: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Request method failure captured: Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 HTTP/1.1 Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMiel5woVhCnfYfYdC-lPyAQHEGpTEdy6obyvRSwaokAoLL7uS0JtJbR6KL-8CpDcoub5f5n5peFJgNDfdt6QAjQyf6e7O9zNvwbqCiOtFwo5zZz7KYN_drxeFwiJuhPGn6fQvwxO1_vXzI0jY8_nDFkAP6AKFh5zf2OWSOwv2slWS8 Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:03:42.975377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0202aa985634c8b8b241ce016600b19", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 82255a5060674d77a554e34f89ab1bff Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:03:42.976831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '2c1140cc-9fea-4464-8b9b-80db1ba7afd0'} Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:03:42.977631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:03:42.978999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:42.980840 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Returning 404 to user: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:03:42.980840 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-79003c49-c9ff-4d11-a2a2-ee553dfc3c22 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 404 len: 111 microversion: 2.1 time: 0.051452 Sep 01 15:03:42.984470 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 302/599] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:42 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:03:42.989463 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-58e189e3-c2c7-424a-9075-438c7e7fa5c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '.version_select at 0x7fab73d66ca0>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:42.994649 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=4 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:43.015473 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:43.016062 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:43.018678 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-58e189e3-c2c7-424a-9075-438c7e7fa5c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094713076" status: 202 len: 0 microversion: 2.1 time: 0.034132 Sep 01 15:03:43.019602 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 298/600] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Sep 1 15:03:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094713076 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 15:03:43.036880 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:43.037486 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:43.038026 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:43.038927 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:43.040268 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:43.040815 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:43.087133 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:43.088505 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:43.089149 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:43.089811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lazy-loading 'fault' on Instance uuid da903e65-d948-457a-8d12-9253ffeacb02 {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:03:43.140560 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:43.150780 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-0fea3595-5008-420b-84b9-58f11b50c0cf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 200 len: 1335 microversion: 2.1 time: 0.139352 Sep 01 15:03:43.151872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 303/601] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:43 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 1335 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:43.958778 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-42f0e587-ea57-44a7-a44d-c92d7a171b53 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Action: 'create', calling method: .version_select at 0x7fab78324160>, body: {"keypair": {"name": "tempest-keypair-475780712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYFHdDboGfWUCrYhZ4QqY3Dv3jnorcUAfe8KkuNGqMDAPxGKrVH4mNwj+PIDYDyBzFx2DE6RyXbsO8IPSdWMfmsk4cUGUAundOwAiQ698jhj3M4vig2Q4Izj9AsJeYT7A=="}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:43.976180 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-42f0e587-ea57-44a7-a44d-c92d7a171b53 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Getting quotas for project b0202aa985634c8b8b241ce016600b19. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:03:43.980833 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-42f0e587-ea57-44a7-a44d-c92d7a171b53 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Getting quotas for user 82255a5060674d77a554e34f89ab1bff and project b0202aa985634c8b8b241ce016600b19. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:03:44.002816 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-42f0e587-ea57-44a7-a44d-c92d7a171b53 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048275 Sep 01 15:03:44.003453 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 299/602] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 1 15:03:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:03:44.172497 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:44.173373 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: da903e65-d948-457a-8d12-9253ffeacb02] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:44.181720 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:44.182374 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:44.182891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:44.183734 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:44.184312 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:44.184926 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:44.199705 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] HTTP exception thrown: Instance da903e65-d948-457a-8d12-9253ffeacb02 could not be found. Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Request method failure captured: Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 HTTP/1.1 Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMidIN0JcFsmPkFozuW1JnVmhGyBAKw0aneJibf-YjO-MihBgOj2bcMNzZsVDgxifrpqibZcbsBfIaam-E-U_Accx2qFeg5B6aOKNhwHlqIN4boLjryK7job98_rcc-LVFONlHm9ujYdWfUeKbdmOrK0H2AEMxC7qHhhTMCvYvL3k1c Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 05e111f88e784eba929741c3cd250e78 Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:03:44.201241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/05e111f88e784eba929741c3cd250e78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/05e111f88e784eba929741c3cd250e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_05e111f88e784eba929741c3cd250e78", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/05e111f88e784eba929741c3cd250e78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 05e111f88e784eba929741c3cd250e78 Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-ServerRescueNegativeTestJSON-2040884132-project Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: df75151c37f74b6da7428dc290a274ff Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2040884132-project Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance da903e65-d948-457a-8d12-9253ffeacb02 could not be found. Sep 01 15:03:44.202733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': 'da903e65-d948-457a-8d12-9253ffeacb02'} Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da903e65-d948-457a-8d12-9253ffeacb02 could not be found. Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:03:44.203657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da903e65-d948-457a-8d12-9253ffeacb02 could not be found. Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da903e65-d948-457a-8d12-9253ffeacb02 could not be found. Sep 01 15:03:44.205022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:44.206398 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Returning 404 to user: Instance da903e65-d948-457a-8d12-9253ffeacb02 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:03:44.206398 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a6b990ad-6db6-4b15-8c6c-87e7c35073aa tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02" status: 404 len: 111 microversion: 2.1 time: 0.034247 Sep 01 15:03:44.206566 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 304/603] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:44 2022] GET /compute/v2.1/servers/da903e65-d948-457a-8d12-9253ffeacb02 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:03:44.214828 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ecc735d7-3ea0-4ac3-bb84-9dc2a582f064 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '.version_select at 0x7fab73d48160>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:44.236797 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ecc735d7-3ea0-4ac3-bb84-9dc2a582f064 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-485175657" status: 202 len: 0 microversion: 2.1 time: 0.027937 Sep 01 15:03:44.237717 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 300/604] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Sep 1 15:03:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-485175657 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:03:45.306417 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-377698560", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b57541cd-ea40-4950-9bc3-3ee45df99819"}], "security_groups": [{"name": "tempest-securitygroup--1019160920"}], "key_name": "tempest-keypair-475780712", "user_data": "}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:45.408714 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.network.neutron [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] validate_networks() for [('b57541cd-ea40-4950-9bc3-3ee45df99819', None, None, None, None, None)] {{(pid=120553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:03:45.883216 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Flavor limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:03:45.883639 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Image limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:03:45.884115 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Flavor pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:03:45.884555 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Image pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:03:45.884968 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:03:45.893609 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:45.894092 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:45.894569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:45.895295 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:45.895754 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:45.896182 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:45.913249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Getting quotas for project b0202aa985634c8b8b241ce016600b19. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:03:45.917667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Getting quotas for user 82255a5060674d77a554e34f89ab1bff and project b0202aa985634c8b8b241ce016600b19. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:03:45.928949 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Going to run 1 instances... {{(pid=120553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:03:45.931891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:03:45.977495 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5f31b0e2-e0a2-477e-a945-f8fb514a9982 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.675348 Sep 01 15:03:45.978652 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 305/605] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:03:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:03:45.990093 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0bf607db-4a2a-4146-80c0-a43b91aeb3c4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:45.990869 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0bf607db-4a2a-4146-80c0-a43b91aeb3c4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:46.051382 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0bf607db-4a2a-4146-80c0-a43b91aeb3c4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:46.061968 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0bf607db-4a2a-4146-80c0-a43b91aeb3c4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1236 microversion: 2.1 time: 0.076300 Sep 01 15:03:46.074836 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 301/606] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:45 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:47.084575 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-334a0fb0-6131-4d03-be58-2f4d157d9460 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:47.085198 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-334a0fb0-6131-4d03-be58-2f4d157d9460 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:47.091759 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-334a0fb0-6131-4d03-be58-2f4d157d9460 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:47.092267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-334a0fb0-6131-4d03-be58-2f4d157d9460 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:47.092703 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-334a0fb0-6131-4d03-be58-2f4d157d9460 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:47.093400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-334a0fb0-6131-4d03-be58-2f4d157d9460 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:47.093857 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-334a0fb0-6131-4d03-be58-2f4d157d9460 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:47.094414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-334a0fb0-6131-4d03-be58-2f4d157d9460 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:47.160090 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-334a0fb0-6131-4d03-be58-2f4d157d9460 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:47.168186 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-334a0fb0-6131-4d03-be58-2f4d157d9460 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1288 microversion: 2.1 time: 0.087987 Sep 01 15:03:47.174282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 306/607] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:47 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:47.174457 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b0ce541e-e892-49b6-9b6e-ca7a58103187 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:47.174914 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b0ce541e-e892-49b6-9b6e-ca7a58103187 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:47.185852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b0ce541e-e892-49b6-9b6e-ca7a58103187 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:47.186397 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b0ce541e-e892-49b6-9b6e-ca7a58103187 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:47.186842 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b0ce541e-e892-49b6-9b6e-ca7a58103187 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:47.187552 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b0ce541e-e892-49b6-9b6e-ca7a58103187 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:47.188019 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b0ce541e-e892-49b6-9b6e-ca7a58103187 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:47.188448 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b0ce541e-e892-49b6-9b6e-ca7a58103187 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:47.215947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b0ce541e-e892-49b6-9b6e-ca7a58103187 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:03:47.302012 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b0ce541e-e892-49b6-9b6e-ca7a58103187 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 204 len: 0 microversion: 2.1 time: 0.131752 Sep 01 15:03:47.302975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 302/608] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:03:47 2022] DELETE /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 15:03:47.311278 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d71877dd-e2e0-4d6c-90eb-04cb62d58a1f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:47.311903 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d71877dd-e2e0-4d6c-90eb-04cb62d58a1f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:47.318369 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d71877dd-e2e0-4d6c-90eb-04cb62d58a1f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:47.318866 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d71877dd-e2e0-4d6c-90eb-04cb62d58a1f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:47.319311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d71877dd-e2e0-4d6c-90eb-04cb62d58a1f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:47.320021 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d71877dd-e2e0-4d6c-90eb-04cb62d58a1f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:47.320483 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d71877dd-e2e0-4d6c-90eb-04cb62d58a1f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:47.320916 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d71877dd-e2e0-4d6c-90eb-04cb62d58a1f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:47.448131 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d71877dd-e2e0-4d6c-90eb-04cb62d58a1f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:47.455923 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d71877dd-e2e0-4d6c-90eb-04cb62d58a1f tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1507 microversion: 2.1 time: 0.148465 Sep 01 15:03:47.456480 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 307/609] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:47 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:48.189305 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ee908f86-4cbb-493c-a1df-2d84dcd3a767 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:48.190014 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ee908f86-4cbb-493c-a1df-2d84dcd3a767 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:48.196310 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee908f86-4cbb-493c-a1df-2d84dcd3a767 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:48.197286 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee908f86-4cbb-493c-a1df-2d84dcd3a767 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:48.197722 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee908f86-4cbb-493c-a1df-2d84dcd3a767 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:48.198455 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee908f86-4cbb-493c-a1df-2d84dcd3a767 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:48.198914 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee908f86-4cbb-493c-a1df-2d84dcd3a767 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:48.199339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee908f86-4cbb-493c-a1df-2d84dcd3a767 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:48.260708 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ee908f86-4cbb-493c-a1df-2d84dcd3a767 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:48.268213 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ee908f86-4cbb-493c-a1df-2d84dcd3a767 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1296 microversion: 2.1 time: 0.083129 Sep 01 15:03:48.268768 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 303/610] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:48 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1296 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:48.475833 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e2eefeb8-99da-4ccc-aa8c-685ea8c673c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:48.476374 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e2eefeb8-99da-4ccc-aa8c-685ea8c673c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:48.482985 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e2eefeb8-99da-4ccc-aa8c-685ea8c673c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:48.483478 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e2eefeb8-99da-4ccc-aa8c-685ea8c673c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:48.483925 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e2eefeb8-99da-4ccc-aa8c-685ea8c673c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:48.484623 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e2eefeb8-99da-4ccc-aa8c-685ea8c673c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:48.485089 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e2eefeb8-99da-4ccc-aa8c-685ea8c673c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:48.485523 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e2eefeb8-99da-4ccc-aa8c-685ea8c673c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:48.616963 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e2eefeb8-99da-4ccc-aa8c-685ea8c673c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:48.625355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e2eefeb8-99da-4ccc-aa8c-685ea8c673c5 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1507 microversion: 2.1 time: 0.153439 Sep 01 15:03:48.625932 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 308/611] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:48 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:49.289546 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3813a663-b1c3-41b2-93e5-77964196adc9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:49.291052 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3813a663-b1c3-41b2-93e5-77964196adc9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:49.293600 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:49.299456 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3813a663-b1c3-41b2-93e5-77964196adc9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:49.299950 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3813a663-b1c3-41b2-93e5-77964196adc9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:49.300392 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3813a663-b1c3-41b2-93e5-77964196adc9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:49.301095 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3813a663-b1c3-41b2-93e5-77964196adc9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:49.301614 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3813a663-b1c3-41b2-93e5-77964196adc9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:49.302045 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3813a663-b1c3-41b2-93e5-77964196adc9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:49.369904 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3813a663-b1c3-41b2-93e5-77964196adc9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:49.377483 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3813a663-b1c3-41b2-93e5-77964196adc9 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1296 microversion: 2.1 time: 0.092384 Sep 01 15:03:49.378045 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 304/612] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:49 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:49.647204 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ca6198ae-948b-4874-b62f-0f0b1ead98ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:49.648124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ca6198ae-948b-4874-b62f-0f0b1ead98ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:49.651741 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:49.657614 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca6198ae-948b-4874-b62f-0f0b1ead98ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:49.658722 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca6198ae-948b-4874-b62f-0f0b1ead98ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:49.659179 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca6198ae-948b-4874-b62f-0f0b1ead98ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:49.659905 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca6198ae-948b-4874-b62f-0f0b1ead98ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:49.660372 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca6198ae-948b-4874-b62f-0f0b1ead98ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:49.660975 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ca6198ae-948b-4874-b62f-0f0b1ead98ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:49.837015 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ca6198ae-948b-4874-b62f-0f0b1ead98ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:49.845235 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ca6198ae-948b-4874-b62f-0f0b1ead98ed tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1507 microversion: 2.1 time: 0.202219 Sep 01 15:03:49.845795 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 309/613] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:49 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:50.336186 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-796991662", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1044275487", "security_groups": [{"name": "tempest-secgroup-smoke-568944986"}], "networks": [{"uuid": "b8634e25-4c97-4a4b-abc4-2cefba213f9c"}], "block_device_mapping_v2": [{"uuid": "e6d2cda5-481c-41af-a102-2e220ac07463", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:50.400014 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5596711d-51d4-4028-99b1-4967e3d1120a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:50.400877 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5596711d-51d4-4028-99b1-4967e3d1120a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:50.408269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5596711d-51d4-4028-99b1-4967e3d1120a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:50.408983 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5596711d-51d4-4028-99b1-4967e3d1120a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:50.409621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5596711d-51d4-4028-99b1-4967e3d1120a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:50.410355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5596711d-51d4-4028-99b1-4967e3d1120a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:50.410820 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5596711d-51d4-4028-99b1-4967e3d1120a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:50.411250 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5596711d-51d4-4028-99b1-4967e3d1120a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:50.415995 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:50.462166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.network.neutron [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] validate_networks() for [('b8634e25-4c97-4a4b-abc4-2cefba213f9c', None, None, None, None, None)] {{(pid=120554) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:03:50.511486 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-5596711d-51d4-4028-99b1-4967e3d1120a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:50.519705 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5596711d-51d4-4028-99b1-4967e3d1120a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1294 microversion: 2.1 time: 0.124361 Sep 01 15:03:50.520538 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 310/614] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:50 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1294 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:50.718964 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-37674c33-a663-4092-a14c-4e056893d105 req-37b08d82-5c59-4c53-af5e-fe2499f1b8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f43e2a43-72fe-4b29-81be-c508b9c9d354", "name": "network-vif-deleted", "tag": "a4b9afd8-08b0-4b00-a627-9a2d62a2f5a2"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:50.742958 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-37674c33-a663-4092-a14c-4e056893d105 req-37b08d82-5c59-4c53-af5e-fe2499f1b8a1 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:50.743481 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-37674c33-a663-4092-a14c-4e056893d105 req-37b08d82-5c59-4c53-af5e-fe2499f1b8a1 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:50.744106 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-37674c33-a663-4092-a14c-4e056893d105 req-37b08d82-5c59-4c53-af5e-fe2499f1b8a1 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:50.757477 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-37674c33-a663-4092-a14c-4e056893d105 req-37b08d82-5c59-4c53-af5e-fe2499f1b8a1 service nova] Creating event network-vif-deleted:a4b9afd8-08b0-4b00-a627-9a2d62a2f5a2 for instance f43e2a43-72fe-4b29-81be-c508b9c9d354 on hv-cinder-85505 Sep 01 15:03:50.763028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-37674c33-a663-4092-a14c-4e056893d105 req-37b08d82-5c59-4c53-af5e-fe2499f1b8a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059615 Sep 01 15:03:50.764342 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 311/615] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:03:50.868861 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:50.871592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:50.882721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:50.883713 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:50.884669 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:50.885808 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:50.886546 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:50.887737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:50.953648 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:50.953858 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Flavor limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:03:50.954340 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:50.954467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Image limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:03:50.954910 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:50.955453 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Flavor pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:03:50.955737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lazy-loading 'fault' on Instance uuid f43e2a43-72fe-4b29-81be-c508b9c9d354 {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:03:50.956040 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Image pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:03:50.957157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:03:50.969102 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:50.969708 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:50.970276 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:50.971106 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:50.971675 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:50.972216 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:51.011351 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Getting quotas for project 764329f7a06b42969616baffd95cbd29. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:03:51.021243 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Getting quotas for user 210bc3fc36724b32ba50364332c6f900 and project 764329f7a06b42969616baffd95cbd29. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:03:51.032153 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:51.042001 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6eef7006-42a8-4a5c-a3f7-6fd375bd77b2 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 200 len: 1311 microversion: 2.1 time: 0.179964 Sep 01 15:03:51.058460 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 312/616] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:50 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 1311 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:51.104869 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Going to run 1 instances... {{(pid=120554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:03:51.107653 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6d2cda5-481c-41af-a102-2e220ac07463',volume_size=None,volume_type=None)] {{(pid=120554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:03:51.260360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-804ccb46-85ac-465a-8c5d-53bea8916df0 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.927913 Sep 01 15:03:51.268508 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 305/617] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:03:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:03:51.272780 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e49e2d01-3e5b-41c3-afb5-074aa9267aaa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:51.273409 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e49e2d01-3e5b-41c3-afb5-074aa9267aaa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:51.339693 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e49e2d01-3e5b-41c3-afb5-074aa9267aaa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:51.347095 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e49e2d01-3e5b-41c3-afb5-074aa9267aaa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1088 microversion: 2.1 time: 0.078096 Sep 01 15:03:51.347677 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 313/618] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:51 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:51.541618 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-db96318f-3699-4ae9-88f3-248d726ad919 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:51.542270 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-db96318f-3699-4ae9-88f3-248d726ad919 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:51.550107 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db96318f-3699-4ae9-88f3-248d726ad919 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:51.550847 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db96318f-3699-4ae9-88f3-248d726ad919 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:51.551293 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db96318f-3699-4ae9-88f3-248d726ad919 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:51.552001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db96318f-3699-4ae9-88f3-248d726ad919 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:51.552494 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db96318f-3699-4ae9-88f3-248d726ad919 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:51.552923 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db96318f-3699-4ae9-88f3-248d726ad919 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:51.709531 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-db96318f-3699-4ae9-88f3-248d726ad919 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:51.719749 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-db96318f-3699-4ae9-88f3-248d726ad919 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1362 microversion: 2.1 time: 0.181891 Sep 01 15:03:51.720725 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 306/619] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:51 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:52.065982 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:52.066792 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: f43e2a43-72fe-4b29-81be-c508b9c9d354] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:52.074081 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:52.074703 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:52.075225 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:52.076076 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:52.076972 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:52.077474 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:52.090891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] HTTP exception thrown: Instance f43e2a43-72fe-4b29-81be-c508b9c9d354 could not be found. Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Request method failure captured: Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 HTTP/1.1 Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMidIN0JcFsmPkFozuW1JnVmhGyBAKw0aneJibf-YjO-MihBgOj2bcMNzZsVDgxifrpqibZcbsBfIaam-E-U_Accx2qFeg5B6aOKNhwHlqIN4boLjryK7job98_rcc-LVFONlHm9ujYdWfUeKbdmOrK0H2AEMxC7qHhhTMCvYvL3k1c Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 05e111f88e784eba929741c3cd250e78 Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:03:52.092536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/05e111f88e784eba929741c3cd250e78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/05e111f88e784eba929741c3cd250e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_05e111f88e784eba929741c3cd250e78", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/05e111f88e784eba929741c3cd250e78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 05e111f88e784eba929741c3cd250e78 Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-ServerRescueNegativeTestJSON-2040884132-project Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: df75151c37f74b6da7428dc290a274ff Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2040884132-project Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance f43e2a43-72fe-4b29-81be-c508b9c9d354 could not be found. Sep 01 15:03:52.093919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': 'f43e2a43-72fe-4b29-81be-c508b9c9d354'} Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f43e2a43-72fe-4b29-81be-c508b9c9d354 could not be found. Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:03:52.094721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f43e2a43-72fe-4b29-81be-c508b9c9d354 could not be found. Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f43e2a43-72fe-4b29-81be-c508b9c9d354 could not be found. Sep 01 15:03:52.096464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:03:52.098070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Returning 404 to user: Instance f43e2a43-72fe-4b29-81be-c508b9c9d354 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:03:52.098070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-3b71c9fd-adcd-45f4-9c9b-483317d71fcf tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354" status: 404 len: 111 microversion: 2.1 time: 0.031909 Sep 01 15:03:52.098070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 314/620] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:52 2022] GET /compute/v2.1/servers/f43e2a43-72fe-4b29-81be-c508b9c9d354 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:03:52.103710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f96c6ace-550d-44f4-8ddb-46364349db26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:52.104418 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f96c6ace-550d-44f4-8ddb-46364349db26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:52.110624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f96c6ace-550d-44f4-8ddb-46364349db26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:52.111117 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f96c6ace-550d-44f4-8ddb-46364349db26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:52.111562 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f96c6ace-550d-44f4-8ddb-46364349db26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:52.112269 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f96c6ace-550d-44f4-8ddb-46364349db26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:52.112831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f96c6ace-550d-44f4-8ddb-46364349db26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:52.113318 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f96c6ace-550d-44f4-8ddb-46364349db26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:52.140578 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f96c6ace-550d-44f4-8ddb-46364349db26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:03:52.170100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:52.218855 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f96c6ace-550d-44f4-8ddb-46364349db26 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 204 len: 0 microversion: 2.1 time: 0.119788 Sep 01 15:03:52.219435 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 307/621] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:03:52 2022] DELETE /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:03:52.227476 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-fb6561b1-4fb5-4e74-be08-9984fce9e5ee tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:52.228692 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-fb6561b1-4fb5-4e74-be08-9984fce9e5ee tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:52.234718 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb6561b1-4fb5-4e74-be08-9984fce9e5ee tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:52.235204 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb6561b1-4fb5-4e74-be08-9984fce9e5ee tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:52.235640 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb6561b1-4fb5-4e74-be08-9984fce9e5ee tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:52.236419 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb6561b1-4fb5-4e74-be08-9984fce9e5ee tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:52.236883 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb6561b1-4fb5-4e74-be08-9984fce9e5ee tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:52.237320 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb6561b1-4fb5-4e74-be08-9984fce9e5ee tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:52.367579 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-fb6561b1-4fb5-4e74-be08-9984fce9e5ee tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:52.369120 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b7f0a4c7-6bda-41bd-bb86-bf78fba478ec tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:52.369831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b7f0a4c7-6bda-41bd-bb86-bf78fba478ec tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:52.375271 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-fb6561b1-4fb5-4e74-be08-9984fce9e5ee tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.151653 Sep 01 15:03:52.375762 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7f0a4c7-6bda-41bd-bb86-bf78fba478ec tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:52.375893 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 315/622] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:52 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:52.376252 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7f0a4c7-6bda-41bd-bb86-bf78fba478ec tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:52.376692 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7f0a4c7-6bda-41bd-bb86-bf78fba478ec tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:52.377554 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7f0a4c7-6bda-41bd-bb86-bf78fba478ec tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:52.377931 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7f0a4c7-6bda-41bd-bb86-bf78fba478ec tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:52.378393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b7f0a4c7-6bda-41bd-bb86-bf78fba478ec tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:52.448206 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b7f0a4c7-6bda-41bd-bb86-bf78fba478ec tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:52.456156 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b7f0a4c7-6bda-41bd-bb86-bf78fba478ec tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1186 microversion: 2.1 time: 0.091200 Sep 01 15:03:52.456820 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 308/623] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:52 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:52.740900 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-56cff16a-1fe3-4320-be33-7b2580a1105d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:52.741524 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-56cff16a-1fe3-4320-be33-7b2580a1105d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:52.747541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56cff16a-1fe3-4320-be33-7b2580a1105d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:52.748074 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56cff16a-1fe3-4320-be33-7b2580a1105d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:52.748526 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56cff16a-1fe3-4320-be33-7b2580a1105d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:52.749220 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56cff16a-1fe3-4320-be33-7b2580a1105d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:52.749689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56cff16a-1fe3-4320-be33-7b2580a1105d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:52.750123 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-56cff16a-1fe3-4320-be33-7b2580a1105d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:52.779374 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-84d18ef0-4e87-41cb-beb1-6d95bf0ba63f req-c7dbf173-ae2a-439a-8142-2cea37172ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db8d4b2-4b38-48ae-addc-67c7e40eabc0", "tag": "89f425d3-f815-4c25-ac37-19f69ecd156b"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:52.789375 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-84d18ef0-4e87-41cb-beb1-6d95bf0ba63f req-c7dbf173-ae2a-439a-8142-2cea37172ea5 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:52.789906 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-84d18ef0-4e87-41cb-beb1-6d95bf0ba63f req-c7dbf173-ae2a-439a-8142-2cea37172ea5 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:52.790393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-84d18ef0-4e87-41cb-beb1-6d95bf0ba63f req-c7dbf173-ae2a-439a-8142-2cea37172ea5 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:52.801289 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-84d18ef0-4e87-41cb-beb1-6d95bf0ba63f req-c7dbf173-ae2a-439a-8142-2cea37172ea5 service nova] Creating event network-changed:89f425d3-f815-4c25-ac37-19f69ecd156b for instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 on hv-cinder-85505 Sep 01 15:03:52.805931 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-84d18ef0-4e87-41cb-beb1-6d95bf0ba63f req-c7dbf173-ae2a-439a-8142-2cea37172ea5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030182 Sep 01 15:03:52.806541 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 309/624] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:03:52.878971 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-56cff16a-1fe3-4320-be33-7b2580a1105d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:52.887114 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-56cff16a-1fe3-4320-be33-7b2580a1105d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1362 microversion: 2.1 time: 0.149991 Sep 01 15:03:52.887594 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 316/625] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:52 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:53.396873 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-39df1e68-9a80-4e84-9666-9e594bcdefce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:53.397575 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-39df1e68-9a80-4e84-9666-9e594bcdefce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:53.403833 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39df1e68-9a80-4e84-9666-9e594bcdefce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:53.404317 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39df1e68-9a80-4e84-9666-9e594bcdefce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:53.404787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39df1e68-9a80-4e84-9666-9e594bcdefce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:53.405476 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39df1e68-9a80-4e84-9666-9e594bcdefce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:53.405936 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39df1e68-9a80-4e84-9666-9e594bcdefce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:53.406400 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39df1e68-9a80-4e84-9666-9e594bcdefce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:53.478977 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-20779d8c-77ac-4ff6-a644-084ab21d0dc4 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:53.479696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-20779d8c-77ac-4ff6-a644-084ab21d0dc4 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:53.486213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20779d8c-77ac-4ff6-a644-084ab21d0dc4 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:53.486730 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20779d8c-77ac-4ff6-a644-084ab21d0dc4 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:53.487170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20779d8c-77ac-4ff6-a644-084ab21d0dc4 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:53.487864 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20779d8c-77ac-4ff6-a644-084ab21d0dc4 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:53.488320 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20779d8c-77ac-4ff6-a644-084ab21d0dc4 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:53.488746 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20779d8c-77ac-4ff6-a644-084ab21d0dc4 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:53.536793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-39df1e68-9a80-4e84-9666-9e594bcdefce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:53.545086 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-39df1e68-9a80-4e84-9666-9e594bcdefce tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.152490 Sep 01 15:03:53.545649 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 310/626] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:53 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:53.554413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-20779d8c-77ac-4ff6-a644-084ab21d0dc4 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:53.562700 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-20779d8c-77ac-4ff6-a644-084ab21d0dc4 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1194 microversion: 2.1 time: 0.088179 Sep 01 15:03:53.563243 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 317/627] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:53 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:53.908260 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-fe604354-c1a5-4440-8e93-b758ef40ce18 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:53.908913 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-fe604354-c1a5-4440-8e93-b758ef40ce18 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:53.916187 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe604354-c1a5-4440-8e93-b758ef40ce18 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:53.916634 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe604354-c1a5-4440-8e93-b758ef40ce18 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:53.917070 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe604354-c1a5-4440-8e93-b758ef40ce18 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:53.917767 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe604354-c1a5-4440-8e93-b758ef40ce18 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:53.918230 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe604354-c1a5-4440-8e93-b758ef40ce18 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:53.918682 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fe604354-c1a5-4440-8e93-b758ef40ce18 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:54.050958 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-fe604354-c1a5-4440-8e93-b758ef40ce18 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:54.058590 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-fe604354-c1a5-4440-8e93-b758ef40ce18 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1362 microversion: 2.1 time: 0.154204 Sep 01 15:03:54.059178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 311/628] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:53 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:54.566679 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f481bce0-b5c8-435a-b294-05dac147fef1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:54.567290 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f481bce0-b5c8-435a-b294-05dac147fef1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:54.574374 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f481bce0-b5c8-435a-b294-05dac147fef1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:54.574854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f481bce0-b5c8-435a-b294-05dac147fef1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:54.575288 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f481bce0-b5c8-435a-b294-05dac147fef1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:54.575970 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f481bce0-b5c8-435a-b294-05dac147fef1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:54.576431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f481bce0-b5c8-435a-b294-05dac147fef1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:54.576874 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f481bce0-b5c8-435a-b294-05dac147fef1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:54.583201 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d4f0fd87-77be-4014-b9a3-c4838b6ff628 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:54.583851 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d4f0fd87-77be-4014-b9a3-c4838b6ff628 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:54.589651 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4f0fd87-77be-4014-b9a3-c4838b6ff628 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:54.590128 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4f0fd87-77be-4014-b9a3-c4838b6ff628 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:54.590600 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4f0fd87-77be-4014-b9a3-c4838b6ff628 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:54.591284 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4f0fd87-77be-4014-b9a3-c4838b6ff628 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:54.591733 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4f0fd87-77be-4014-b9a3-c4838b6ff628 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:54.592157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4f0fd87-77be-4014-b9a3-c4838b6ff628 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:54.653254 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d4f0fd87-77be-4014-b9a3-c4838b6ff628 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:54.663761 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d4f0fd87-77be-4014-b9a3-c4838b6ff628 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1194 microversion: 2.1 time: 0.084242 Sep 01 15:03:54.664528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 312/629] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:54 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:54.709736 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f481bce0-b5c8-435a-b294-05dac147fef1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:54.717521 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f481bce0-b5c8-435a-b294-05dac147fef1 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.154664 Sep 01 15:03:54.718070 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 318/630] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:54 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:55.079673 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b21bd5d1-8f36-4494-86e2-15bf9b3b8a4e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:55.080285 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b21bd5d1-8f36-4494-86e2-15bf9b3b8a4e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:55.086634 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b21bd5d1-8f36-4494-86e2-15bf9b3b8a4e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:55.087118 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b21bd5d1-8f36-4494-86e2-15bf9b3b8a4e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:55.087550 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b21bd5d1-8f36-4494-86e2-15bf9b3b8a4e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:55.088232 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b21bd5d1-8f36-4494-86e2-15bf9b3b8a4e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:55.088687 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b21bd5d1-8f36-4494-86e2-15bf9b3b8a4e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:55.089111 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b21bd5d1-8f36-4494-86e2-15bf9b3b8a4e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:55.219063 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b21bd5d1-8f36-4494-86e2-15bf9b3b8a4e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:55.226766 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b21bd5d1-8f36-4494-86e2-15bf9b3b8a4e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1362 microversion: 2.1 time: 0.150916 Sep 01 15:03:55.227320 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 313/631] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:55 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:55.685798 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9a0b3cd5-77df-4ebc-bd8d-dde358f0bc1d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:55.686465 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9a0b3cd5-77df-4ebc-bd8d-dde358f0bc1d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:55.692840 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a0b3cd5-77df-4ebc-bd8d-dde358f0bc1d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:55.693327 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a0b3cd5-77df-4ebc-bd8d-dde358f0bc1d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:55.693770 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a0b3cd5-77df-4ebc-bd8d-dde358f0bc1d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:55.694487 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a0b3cd5-77df-4ebc-bd8d-dde358f0bc1d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:55.694941 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a0b3cd5-77df-4ebc-bd8d-dde358f0bc1d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:55.695364 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a0b3cd5-77df-4ebc-bd8d-dde358f0bc1d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:55.738395 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-931f0c7e-6a64-4438-992f-a58196aa8156 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:55.739006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-931f0c7e-6a64-4438-992f-a58196aa8156 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:55.744843 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-931f0c7e-6a64-4438-992f-a58196aa8156 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:55.745325 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-931f0c7e-6a64-4438-992f-a58196aa8156 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:55.745767 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-931f0c7e-6a64-4438-992f-a58196aa8156 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:55.746492 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-931f0c7e-6a64-4438-992f-a58196aa8156 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:55.746933 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-931f0c7e-6a64-4438-992f-a58196aa8156 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:55.747353 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-931f0c7e-6a64-4438-992f-a58196aa8156 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:55.756205 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9a0b3cd5-77df-4ebc-bd8d-dde358f0bc1d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:55.765514 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9a0b3cd5-77df-4ebc-bd8d-dde358f0bc1d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1204 microversion: 2.1 time: 0.084758 Sep 01 15:03:55.770336 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 319/632] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:55 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1204 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:55.960981 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-931f0c7e-6a64-4438-992f-a58196aa8156 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:55.969242 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-931f0c7e-6a64-4438-992f-a58196aa8156 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1522 microversion: 2.1 time: 0.234626 Sep 01 15:03:55.970040 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 314/633] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:55 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:56.248822 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-609f5516-af79-4b2f-97ea-f5142e2780b4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:56.249453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-609f5516-af79-4b2f-97ea-f5142e2780b4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:56.254948 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:03:56.256495 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-609f5516-af79-4b2f-97ea-f5142e2780b4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:56.257392 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-609f5516-af79-4b2f-97ea-f5142e2780b4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:56.257800 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-609f5516-af79-4b2f-97ea-f5142e2780b4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:56.258589 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-609f5516-af79-4b2f-97ea-f5142e2780b4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:56.259882 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-609f5516-af79-4b2f-97ea-f5142e2780b4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:56.260540 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-609f5516-af79-4b2f-97ea-f5142e2780b4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:56.356793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-c4ce7fdd-34ff-4687-aaec-0ddb45de40af req-682867d0-6250-4fe6-9e62-e3d8c2a8da04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7322e2bb-f39f-46ee-9193-1edd605d833f", "name": "network-vif-deleted", "tag": "15dcee05-385b-4dbf-9d4a-1e83e723059e"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:56.366858 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-c4ce7fdd-34ff-4687-aaec-0ddb45de40af req-682867d0-6250-4fe6-9e62-e3d8c2a8da04 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:56.367427 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-c4ce7fdd-34ff-4687-aaec-0ddb45de40af req-682867d0-6250-4fe6-9e62-e3d8c2a8da04 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:56.367937 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-c4ce7fdd-34ff-4687-aaec-0ddb45de40af req-682867d0-6250-4fe6-9e62-e3d8c2a8da04 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:56.380150 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-c4ce7fdd-34ff-4687-aaec-0ddb45de40af req-682867d0-6250-4fe6-9e62-e3d8c2a8da04 service nova] Creating event network-vif-deleted:15dcee05-385b-4dbf-9d4a-1e83e723059e for instance 7322e2bb-f39f-46ee-9193-1edd605d833f on hv-cinder-85505 Sep 01 15:03:56.385340 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-c4ce7fdd-34ff-4687-aaec-0ddb45de40af req-682867d0-6250-4fe6-9e62-e3d8c2a8da04 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034052 Sep 01 15:03:56.386115 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 315/634] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:03:56.477320 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-609f5516-af79-4b2f-97ea-f5142e2780b4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:56.486034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-609f5516-af79-4b2f-97ea-f5142e2780b4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1362 microversion: 2.1 time: 0.241807 Sep 01 15:03:56.487024 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 320/635] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:56 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:56.791568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d95a38ee-b063-4167-be71-4e20acc53161 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:56.792585 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d95a38ee-b063-4167-be71-4e20acc53161 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:56.808010 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d95a38ee-b063-4167-be71-4e20acc53161 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:56.808724 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d95a38ee-b063-4167-be71-4e20acc53161 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:56.809336 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d95a38ee-b063-4167-be71-4e20acc53161 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:56.810254 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d95a38ee-b063-4167-be71-4e20acc53161 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:56.813467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d95a38ee-b063-4167-be71-4e20acc53161 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:56.814097 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d95a38ee-b063-4167-be71-4e20acc53161 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:56.990731 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:56.991426 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:56.999832 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:57.000612 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:57.001851 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:57.002891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:57.003560 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:57.004188 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:57.040866 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:57.042441 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:57.042896 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:57.043367 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lazy-loading 'fault' on Instance uuid 7322e2bb-f39f-46ee-9193-1edd605d833f {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:03:57.072683 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d95a38ee-b063-4167-be71-4e20acc53161 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:57.080507 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d95a38ee-b063-4167-be71-4e20acc53161 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1271 microversion: 2.1 time: 0.296324 Sep 01 15:03:57.081153 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 316/636] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:56 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1271 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:57.115171 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df75151c37f74b6da7428dc290a274ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e111f88e784eba929741c3cd250e78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:57.124581 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7f0d2314-f26c-4458-8c8e-8d02693a2763 tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 200 len: 1312 microversion: 2.1 time: 0.137296 Sep 01 15:03:57.125172 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 321/637] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:56 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 1312 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:57.217723 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c5e3b394-b6e4-4ec9-bbd0-e5f28554cee8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:57.218219 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c5e3b394-b6e4-4ec9-bbd0-e5f28554cee8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:57.224063 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5e3b394-b6e4-4ec9-bbd0-e5f28554cee8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:57.224549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5e3b394-b6e4-4ec9-bbd0-e5f28554cee8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:57.224987 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5e3b394-b6e4-4ec9-bbd0-e5f28554cee8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:57.225690 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5e3b394-b6e4-4ec9-bbd0-e5f28554cee8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:57.226184 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5e3b394-b6e4-4ec9-bbd0-e5f28554cee8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:57.226623 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c5e3b394-b6e4-4ec9-bbd0-e5f28554cee8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:57.251828 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c5e3b394-b6e4-4ec9-bbd0-e5f28554cee8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/ips" status: 200 len: 153 microversion: 2.20 time: 0.162192 Sep 01 15:03:57.252457 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 317/638] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Sep 1 15:03:57 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/ips => generated 153 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 15:03:57.493412 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-cb7d532d-a15d-4349-a4d8-c3e7d00a4dad req-a7255e02-c344-43bc-9fc8-508bb4ba6724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a", "tag": "ee2ec77e-7de7-43b9-b302-bffde8d5f382"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:57.510460 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4d95c385-c7a7-4472-bbc4-7a67c4e6445a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:57.522681 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4d95c385-c7a7-4472-bbc4-7a67c4e6445a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:57.534568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d95c385-c7a7-4472-bbc4-7a67c4e6445a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:57.535076 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d95c385-c7a7-4472-bbc4-7a67c4e6445a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:57.535581 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d95c385-c7a7-4472-bbc4-7a67c4e6445a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:57.536373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d95c385-c7a7-4472-bbc4-7a67c4e6445a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:57.536836 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d95c385-c7a7-4472-bbc4-7a67c4e6445a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:57.537266 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4d95c385-c7a7-4472-bbc4-7a67c4e6445a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:57.551016 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-cb7d532d-a15d-4349-a4d8-c3e7d00a4dad req-a7255e02-c344-43bc-9fc8-508bb4ba6724 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:57.554431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-cb7d532d-a15d-4349-a4d8-c3e7d00a4dad req-a7255e02-c344-43bc-9fc8-508bb4ba6724 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:57.555247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-cb7d532d-a15d-4349-a4d8-c3e7d00a4dad req-a7255e02-c344-43bc-9fc8-508bb4ba6724 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:57.585399 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-cb7d532d-a15d-4349-a4d8-c3e7d00a4dad req-a7255e02-c344-43bc-9fc8-508bb4ba6724 service nova] Creating event network-changed:ee2ec77e-7de7-43b9-b302-bffde8d5f382 for instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a on hv-cinder-85505 Sep 01 15:03:57.591520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-cb7d532d-a15d-4349-a4d8-c3e7d00a4dad req-a7255e02-c344-43bc-9fc8-508bb4ba6724 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105879 Sep 01 15:03:57.592417 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 322/639] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:03:57.789360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4d95c385-c7a7-4472-bbc4-7a67c4e6445a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:57.798756 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4d95c385-c7a7-4472-bbc4-7a67c4e6445a tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1362 microversion: 2.1 time: 0.293645 Sep 01 15:03:57.799335 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 318/640] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:57 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:58.101855 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8aa96c45-b9ea-4438-a045-0a151c4ce4dc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:58.102635 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8aa96c45-b9ea-4438-a045-0a151c4ce4dc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:58.108692 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8aa96c45-b9ea-4438-a045-0a151c4ce4dc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:58.109179 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8aa96c45-b9ea-4438-a045-0a151c4ce4dc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:58.109611 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8aa96c45-b9ea-4438-a045-0a151c4ce4dc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:58.110311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8aa96c45-b9ea-4438-a045-0a151c4ce4dc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:58.110767 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8aa96c45-b9ea-4438-a045-0a151c4ce4dc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:58.111194 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8aa96c45-b9ea-4438-a045-0a151c4ce4dc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:58.146927 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:58.147501 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] [instance: 7322e2bb-f39f-46ee-9193-1edd605d833f] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:58.154985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:58.155477 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:58.155914 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:58.156612 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:58.157065 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:58.157487 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:58.170916 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] HTTP exception thrown: Instance 7322e2bb-f39f-46ee-9193-1edd605d833f could not be found. Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Request method failure captured: Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f HTTP/1.1 Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMidIN0JcFsmPkFozuW1JnVmhGyBAKw0aneJibf-YjO-MihBgOj2bcMNzZsVDgxifrpqibZcbsBfIaam-E-U_Accx2qFeg5B6aOKNhwHlqIN4boLjryK7job98_rcc-LVFONlHm9ujYdWfUeKbdmOrK0H2AEMxC7qHhhTMCvYvL3k1c Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 05e111f88e784eba929741c3cd250e78 Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:03:58.172837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/05e111f88e784eba929741c3cd250e78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/05e111f88e784eba929741c3cd250e78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_05e111f88e784eba929741c3cd250e78", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/05e111f88e784eba929741c3cd250e78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 05e111f88e784eba929741c3cd250e78 Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2040884132 Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-ServerRescueNegativeTestJSON-2040884132-project Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: df75151c37f74b6da7428dc290a274ff Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2040884132-project Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 7322e2bb-f39f-46ee-9193-1edd605d833f could not be found. Sep 01 15:03:58.174454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '7322e2bb-f39f-46ee-9193-1edd605d833f'} Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7322e2bb-f39f-46ee-9193-1edd605d833f could not be found. Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:03:58.175571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7322e2bb-f39f-46ee-9193-1edd605d833f could not be found. Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7322e2bb-f39f-46ee-9193-1edd605d833f could not be found. Sep 01 15:03:58.176822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:03:58.178005 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] Returning 404 to user: Instance 7322e2bb-f39f-46ee-9193-1edd605d833f could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:03:58.178005 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-1dd2c62f-3a3b-49c3-9784-f8b702482bad tempest-ServerRescueNegativeTestJSON-2040884132 tempest-ServerRescueNegativeTestJSON-2040884132-project] 10.222.0.33 "GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f" status: 404 len: 111 microversion: 2.1 time: 0.031124 Sep 01 15:03:58.178005 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 319/641] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:58 2022] GET /compute/v2.1/servers/7322e2bb-f39f-46ee-9193-1edd605d833f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 15:03:58.325531 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8aa96c45-b9ea-4438-a045-0a151c4ce4dc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:58.333606 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8aa96c45-b9ea-4438-a045-0a151c4ce4dc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1259 microversion: 2.1 time: 0.236394 Sep 01 15:03:58.334455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 323/642] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:58 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1259 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:03:58.819310 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-03f76023-58d7-491a-bdf1-4161e142de20 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:58.820034 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-03f76023-58d7-491a-bdf1-4161e142de20 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:58.828084 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03f76023-58d7-491a-bdf1-4161e142de20 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:58.828575 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03f76023-58d7-491a-bdf1-4161e142de20 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:58.829021 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03f76023-58d7-491a-bdf1-4161e142de20 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:58.829722 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03f76023-58d7-491a-bdf1-4161e142de20 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:58.830183 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03f76023-58d7-491a-bdf1-4161e142de20 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:58.830639 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03f76023-58d7-491a-bdf1-4161e142de20 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:59.015839 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-03f76023-58d7-491a-bdf1-4161e142de20 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:59.024114 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-03f76023-58d7-491a-bdf1-4161e142de20 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1362 microversion: 2.1 time: 0.208670 Sep 01 15:03:59.025505 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 320/643] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:58 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:03:59.325758 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-19c457c1-88b4-4755-bea4-adfb5a52ce10 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:03:59.326431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-19c457c1-88b4-4755-bea4-adfb5a52ce10 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:59.332746 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-19c457c1-88b4-4755-bea4-adfb5a52ce10 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:59.333239 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-19c457c1-88b4-4755-bea4-adfb5a52ce10 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:59.333741 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-19c457c1-88b4-4755-bea4-adfb5a52ce10 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:59.334489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-19c457c1-88b4-4755-bea4-adfb5a52ce10 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:59.334947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-19c457c1-88b4-4755-bea4-adfb5a52ce10 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:59.335381 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-19c457c1-88b4-4755-bea4-adfb5a52ce10 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:59.354550 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a802c779-7330-4554-9fdb-3ca5fcd71383 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:59.354932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a802c779-7330-4554-9fdb-3ca5fcd71383 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:59.363229 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a802c779-7330-4554-9fdb-3ca5fcd71383 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:59.363725 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a802c779-7330-4554-9fdb-3ca5fcd71383 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:59.364167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a802c779-7330-4554-9fdb-3ca5fcd71383 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:59.364886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a802c779-7330-4554-9fdb-3ca5fcd71383 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:59.365381 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a802c779-7330-4554-9fdb-3ca5fcd71383 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:59.365808 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a802c779-7330-4554-9fdb-3ca5fcd71383 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:59.380642 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-19c457c1-88b4-4755-bea4-adfb5a52ce10 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lazy-loading 'flavor' on Instance uuid 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:03:59.578749 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-19c457c1-88b4-4755-bea4-adfb5a52ce10 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "POST /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/action" status: 202 len: 0 microversion: 2.20 time: 0.257063 Sep 01 15:03:59.579386 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 324/644] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Sep 1 15:03:59 2022] POST /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 15:03:59.589643 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:03:59.590729 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:03:59.597797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:59.598586 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:59.599209 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:59.599914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:03:59.600375 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:03:59.600843 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:03:59.748733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:59.757004 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:59.758535 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:59.760282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-af6e83ae-4808-46da-a0b5-4464f64d8f81 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.175951 Sep 01 15:03:59.760893 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 325/645] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:03:59 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:03:59.776384 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a802c779-7330-4554-9fdb-3ca5fcd71383 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:03:59.784114 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a802c779-7330-4554-9fdb-3ca5fcd71383 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1259 microversion: 2.1 time: 0.433947 Sep 01 15:03:59.784681 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 321/646] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:03:59 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1259 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:04:00.046195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c51d7796-6823-4999-b98a-124c9edb3060 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:00.047122 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c51d7796-6823-4999-b98a-124c9edb3060 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:00.053480 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c51d7796-6823-4999-b98a-124c9edb3060 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:00.054092 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c51d7796-6823-4999-b98a-124c9edb3060 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:00.054693 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c51d7796-6823-4999-b98a-124c9edb3060 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:00.056300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c51d7796-6823-4999-b98a-124c9edb3060 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:00.056899 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c51d7796-6823-4999-b98a-124c9edb3060 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:00.057449 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c51d7796-6823-4999-b98a-124c9edb3060 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:00.194614 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c51d7796-6823-4999-b98a-124c9edb3060 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:00.203074 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c51d7796-6823-4999-b98a-124c9edb3060 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1362 microversion: 2.1 time: 0.161280 Sep 01 15:04:00.204863 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 326/647] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:00 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:00.785493 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:00.786189 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:00.793129 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:00.793693 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:00.794200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:00.795021 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:00.795575 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:00.796074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:00.804612 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-96d36ec8-e5fb-4310-a789-9f68790e550a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:00.805367 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-96d36ec8-e5fb-4310-a789-9f68790e550a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:00.813735 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96d36ec8-e5fb-4310-a789-9f68790e550a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:00.814213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96d36ec8-e5fb-4310-a789-9f68790e550a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:00.814727 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96d36ec8-e5fb-4310-a789-9f68790e550a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:00.815540 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96d36ec8-e5fb-4310-a789-9f68790e550a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:00.816010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96d36ec8-e5fb-4310-a789-9f68790e550a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:00.816612 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-96d36ec8-e5fb-4310-a789-9f68790e550a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:00.822044 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:00.966704 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-96d36ec8-e5fb-4310-a789-9f68790e550a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:00.975792 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-96d36ec8-e5fb-4310-a789-9f68790e550a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1259 microversion: 2.1 time: 0.174888 Sep 01 15:04:00.987479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:00.989152 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 327/648] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:00 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:04:01.005362 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:01.014373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:01.015917 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:01.017172 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-aaa4eb5e-d12c-488c-9f4e-7437161c819c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.235639 Sep 01 15:04:01.018137 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 322/649] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:00 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:01.163304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-044d9117-327c-4010-9adc-bfb6ae558e24 req-bb461677-f158-4812-9693-f2d376328615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db8d4b2-4b38-48ae-addc-67c7e40eabc0", "name": "network-vif-plugged", "status": "completed", "tag": "89f425d3-f815-4c25-ac37-19f69ecd156b"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:01.173467 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-044d9117-327c-4010-9adc-bfb6ae558e24 req-bb461677-f158-4812-9693-f2d376328615 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:01.173951 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-044d9117-327c-4010-9adc-bfb6ae558e24 req-bb461677-f158-4812-9693-f2d376328615 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:01.174417 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-044d9117-327c-4010-9adc-bfb6ae558e24 req-bb461677-f158-4812-9693-f2d376328615 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:01.185811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-044d9117-327c-4010-9adc-bfb6ae558e24 req-bb461677-f158-4812-9693-f2d376328615 service nova] Creating event network-vif-plugged:89f425d3-f815-4c25-ac37-19f69ecd156b for instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 on hv-cinder-85505 Sep 01 15:04:01.190852 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-044d9117-327c-4010-9adc-bfb6ae558e24 req-bb461677-f158-4812-9693-f2d376328615 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031691 Sep 01 15:04:01.191612 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 328/650] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:04:01.224624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2050e48c-f839-47e3-835f-1635c6bdfe0d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:01.227270 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2050e48c-f839-47e3-835f-1635c6bdfe0d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:01.232766 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=12 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:01.234562 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2050e48c-f839-47e3-835f-1635c6bdfe0d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:01.235223 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2050e48c-f839-47e3-835f-1635c6bdfe0d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:01.235767 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2050e48c-f839-47e3-835f-1635c6bdfe0d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:01.236574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2050e48c-f839-47e3-835f-1635c6bdfe0d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:01.237106 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2050e48c-f839-47e3-835f-1635c6bdfe0d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:01.237607 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2050e48c-f839-47e3-835f-1635c6bdfe0d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:01.482922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2050e48c-f839-47e3-835f-1635c6bdfe0d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:01.490993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2050e48c-f839-47e3-835f-1635c6bdfe0d tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1362 microversion: 2.1 time: 0.271455 Sep 01 15:04:01.491811 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 323/651] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:01 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:01.993776 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=8 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:01.998856 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-34c87ab1-9a9d-461c-b4dc-9484256ee32a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:01.999565 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-34c87ab1-9a9d-461c-b4dc-9484256ee32a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:02.006045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-34c87ab1-9a9d-461c-b4dc-9484256ee32a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:02.006571 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-34c87ab1-9a9d-461c-b4dc-9484256ee32a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:02.007012 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-34c87ab1-9a9d-461c-b4dc-9484256ee32a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:02.007707 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-34c87ab1-9a9d-461c-b4dc-9484256ee32a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:02.008165 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-34c87ab1-9a9d-461c-b4dc-9484256ee32a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:02.008622 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-34c87ab1-9a9d-461c-b4dc-9484256ee32a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:02.053571 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:02.054408 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:02.061088 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:02.061731 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:02.062296 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:02.063217 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:02.063778 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:02.064306 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:02.163973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-34c87ab1-9a9d-461c-b4dc-9484256ee32a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:02.175109 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-34c87ab1-9a9d-461c-b4dc-9484256ee32a tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1259 microversion: 2.1 time: 0.182320 Sep 01 15:04:02.175929 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 329/652] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:01 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:02.230640 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:02.238805 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:02.240434 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:02.241660 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3582dd06-d08c-402d-bb62-4dbffb5338b0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.204343 Sep 01 15:04:02.242309 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 324/653] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:02 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:04:02.513413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-43457369-7e42-40bc-bc28-e0f2011f1aff tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:02.514403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-43457369-7e42-40bc-bc28-e0f2011f1aff tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:02.520492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-43457369-7e42-40bc-bc28-e0f2011f1aff tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:02.520982 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-43457369-7e42-40bc-bc28-e0f2011f1aff tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:02.521420 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-43457369-7e42-40bc-bc28-e0f2011f1aff tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:02.522135 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-43457369-7e42-40bc-bc28-e0f2011f1aff tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:02.522616 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-43457369-7e42-40bc-bc28-e0f2011f1aff tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:02.523051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-43457369-7e42-40bc-bc28-e0f2011f1aff tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:02.667908 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-43457369-7e42-40bc-bc28-e0f2011f1aff tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:02.676671 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-43457369-7e42-40bc-bc28-e0f2011f1aff tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1362 microversion: 2.1 time: 0.168305 Sep 01 15:04:02.677226 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 330/654] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:02 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:03.195875 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e7e44397-b200-4d4e-af4c-35f930e67813 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:03.196659 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e7e44397-b200-4d4e-af4c-35f930e67813 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:03.203715 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7e44397-b200-4d4e-af4c-35f930e67813 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:03.204320 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7e44397-b200-4d4e-af4c-35f930e67813 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:03.204784 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7e44397-b200-4d4e-af4c-35f930e67813 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:03.205495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7e44397-b200-4d4e-af4c-35f930e67813 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:03.205966 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7e44397-b200-4d4e-af4c-35f930e67813 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:03.206493 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e7e44397-b200-4d4e-af4c-35f930e67813 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:03.264566 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:03.265403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:03.271753 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:03.272344 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:03.272845 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:03.273676 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:03.274463 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:03.274954 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:03.411972 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:03.421231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:03.422951 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:03.424101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-15c8db33-ff50-4a83-a536-ed7b038f18e7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.163503 Sep 01 15:04:03.424647 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 331/655] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:03 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:04:03.441147 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e7e44397-b200-4d4e-af4c-35f930e67813 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:03.444663 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:03.449822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e7e44397-b200-4d4e-af4c-35f930e67813 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1259 microversion: 2.1 time: 0.257848 Sep 01 15:04:03.450402 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 325/656] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:03 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:03.697055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b3e570d1-2ada-4361-937f-8a685ca6c8a7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:03.697945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b3e570d1-2ada-4361-937f-8a685ca6c8a7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:03.705625 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3e570d1-2ada-4361-937f-8a685ca6c8a7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:03.706055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3e570d1-2ada-4361-937f-8a685ca6c8a7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:03.706738 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3e570d1-2ada-4361-937f-8a685ca6c8a7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:03.707478 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3e570d1-2ada-4361-937f-8a685ca6c8a7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:03.708101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3e570d1-2ada-4361-937f-8a685ca6c8a7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:03.708835 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b3e570d1-2ada-4361-937f-8a685ca6c8a7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:03.845567 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b3e570d1-2ada-4361-937f-8a685ca6c8a7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:03.854685 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b3e570d1-2ada-4361-937f-8a685ca6c8a7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1548 microversion: 2.1 time: 0.161352 Sep 01 15:04:03.855560 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 332/657] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:03 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:03.875904 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-8d439df5-f8ee-41f0-96e3-8c5e61a577d3 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:03.876547 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-8d439df5-f8ee-41f0-96e3-8c5e61a577d3 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:03.883273 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8d439df5-f8ee-41f0-96e3-8c5e61a577d3 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:03.884327 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8d439df5-f8ee-41f0-96e3-8c5e61a577d3 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:03.884773 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8d439df5-f8ee-41f0-96e3-8c5e61a577d3 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:03.885477 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8d439df5-f8ee-41f0-96e3-8c5e61a577d3 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:03.885940 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8d439df5-f8ee-41f0-96e3-8c5e61a577d3 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:03.886444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8d439df5-f8ee-41f0-96e3-8c5e61a577d3 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:04.030726 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-8d439df5-f8ee-41f0-96e3-8c5e61a577d3 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158835 Sep 01 15:04:04.031313 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 326/658] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 1 15:04:03 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:04.459331 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:04.459961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:04.471383 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ef8df2bb-75d6-4385-abaf-a241f0dfde05 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:04.472017 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ef8df2bb-75d6-4385-abaf-a241f0dfde05 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:04.476738 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:04.477578 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:04.478418 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:04.480543 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef8df2bb-75d6-4385-abaf-a241f0dfde05 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:04.483261 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:04.483807 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:04.484259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:04.486017 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef8df2bb-75d6-4385-abaf-a241f0dfde05 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:04.486749 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef8df2bb-75d6-4385-abaf-a241f0dfde05 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:04.487838 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef8df2bb-75d6-4385-abaf-a241f0dfde05 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:04.490321 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef8df2bb-75d6-4385-abaf-a241f0dfde05 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:04.490748 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef8df2bb-75d6-4385-abaf-a241f0dfde05 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:04.767480 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:04.777102 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:04.778739 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:04.780110 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-aed31ef3-5330-4ecf-b4c1-d462d212d6ee tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.336903 Sep 01 15:04:04.781142 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 333/659] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:04 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:04.794868 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ef8df2bb-75d6-4385-abaf-a241f0dfde05 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:04.804286 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ef8df2bb-75d6-4385-abaf-a241f0dfde05 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1259 microversion: 2.1 time: 0.336645 Sep 01 15:04:04.804862 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 327/660] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:04 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1259 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:05.344832 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-71375bb1-43df-44df-b87c-934d98deb4b4 req-ebdc0d32-0d2d-4a6f-a98c-2746287235b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db8d4b2-4b38-48ae-addc-67c7e40eabc0", "tag": "89f425d3-f815-4c25-ac37-19f69ecd156b"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:05.358091 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-71375bb1-43df-44df-b87c-934d98deb4b4 req-ebdc0d32-0d2d-4a6f-a98c-2746287235b9 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:05.359109 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-71375bb1-43df-44df-b87c-934d98deb4b4 req-ebdc0d32-0d2d-4a6f-a98c-2746287235b9 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:05.359758 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-71375bb1-43df-44df-b87c-934d98deb4b4 req-ebdc0d32-0d2d-4a6f-a98c-2746287235b9 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:05.373709 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-71375bb1-43df-44df-b87c-934d98deb4b4 req-ebdc0d32-0d2d-4a6f-a98c-2746287235b9 service nova] Creating event network-changed:89f425d3-f815-4c25-ac37-19f69ecd156b for instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 on hv-cinder-85505 Sep 01 15:04:05.382047 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-71375bb1-43df-44df-b87c-934d98deb4b4 req-ebdc0d32-0d2d-4a6f-a98c-2746287235b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190364 Sep 01 15:04:05.382999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 334/661] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:05.804011 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:05.805368 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:05.814117 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:05.815076 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:05.815786 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:05.816782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:05.817450 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:05.818265 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:05.825678 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-12a38cf9-f7ef-4a32-bcc2-c35ccb7ab92d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:05.827150 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-12a38cf9-f7ef-4a32-bcc2-c35ccb7ab92d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:05.840214 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12a38cf9-f7ef-4a32-bcc2-c35ccb7ab92d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:05.844191 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12a38cf9-f7ef-4a32-bcc2-c35ccb7ab92d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:05.845002 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12a38cf9-f7ef-4a32-bcc2-c35ccb7ab92d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:05.848603 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12a38cf9-f7ef-4a32-bcc2-c35ccb7ab92d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:05.849552 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12a38cf9-f7ef-4a32-bcc2-c35ccb7ab92d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:05.851104 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12a38cf9-f7ef-4a32-bcc2-c35ccb7ab92d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:06.082683 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:06.099069 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:06.100909 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:06.107829 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-08c308b8-380e-4764-873c-6aca5df56680 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.308584 Sep 01 15:04:06.108744 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 328/662] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:05 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:06.407808 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-12a38cf9-f7ef-4a32-bcc2-c35ccb7ab92d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:06.419834 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-12a38cf9-f7ef-4a32-bcc2-c35ccb7ab92d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1259 microversion: 2.1 time: 0.598619 Sep 01 15:04:06.421543 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 335/663] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:05 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1259 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:07.136401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:07.137893 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:07.144572 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:07.145277 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:07.145819 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:07.146596 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:07.147149 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:07.148047 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:07.406094 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:07.416679 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:07.418749 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:07.420057 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-39ed183c-5921-498b-aa84-208b24d99f76 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.289564 Sep 01 15:04:07.432088 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 329/664] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:07 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:07.443460 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-29386d1d-50fd-499c-b393-f7b0f3632d2f tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:07.444934 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-29386d1d-50fd-499c-b393-f7b0f3632d2f tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:07.455460 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-29386d1d-50fd-499c-b393-f7b0f3632d2f tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:07.456247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-29386d1d-50fd-499c-b393-f7b0f3632d2f tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:07.457421 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-29386d1d-50fd-499c-b393-f7b0f3632d2f tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:07.459372 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-29386d1d-50fd-499c-b393-f7b0f3632d2f tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:07.460071 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-29386d1d-50fd-499c-b393-f7b0f3632d2f tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:07.461257 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-29386d1d-50fd-499c-b393-f7b0f3632d2f tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:07.655922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-0076d1a3-d757-4d88-96c4-2931dd3528f9 req-e0b37bb9-acff-4c45-ab65-d4c1c3e6bd6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a", "name": "network-vif-plugged", "status": "completed", "tag": "ee2ec77e-7de7-43b9-b302-bffde8d5f382"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:07.674155 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-0076d1a3-d757-4d88-96c4-2931dd3528f9 req-e0b37bb9-acff-4c45-ab65-d4c1c3e6bd6e service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:07.674706 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-0076d1a3-d757-4d88-96c4-2931dd3528f9 req-e0b37bb9-acff-4c45-ab65-d4c1c3e6bd6e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:07.675146 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-0076d1a3-d757-4d88-96c4-2931dd3528f9 req-e0b37bb9-acff-4c45-ab65-d4c1c3e6bd6e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:07.698041 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-29386d1d-50fd-499c-b393-f7b0f3632d2f tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:07.703047 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-0076d1a3-d757-4d88-96c4-2931dd3528f9 req-e0b37bb9-acff-4c45-ab65-d4c1c3e6bd6e service nova] Creating event network-vif-plugged:ee2ec77e-7de7-43b9-b302-bffde8d5f382 for instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a on hv-cinder-85505 Sep 01 15:04:07.707780 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-29386d1d-50fd-499c-b393-f7b0f3632d2f tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1259 microversion: 2.1 time: 0.268729 Sep 01 15:04:07.708364 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 336/665] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:07 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1259 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:07.726712 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-0076d1a3-d757-4d88-96c4-2931dd3528f9 req-e0b37bb9-acff-4c45-ab65-d4c1c3e6bd6e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076234 Sep 01 15:04:07.727661 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 330/666] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:08.083300 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f24b6260-0cfa-4a2d-81a7-1e41ae567ede tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: .version_select at 0x7fab73d66dc0>, body: {"keypair": {"name": "tempest-keypair-127803300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDHngnbqXQ+FHJnJVInE6pnVHmXmz4ontxVA+PgRWHH2Z89qg6Otj2PhnFoTAG3cvTS8U8X/0sDiGEoUYqTPsKGSfVqKogltIjo2iUTvRxb4aXKoLvdtajGiDL9fKhbvQ=="}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:08.099743 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-f24b6260-0cfa-4a2d-81a7-1e41ae567ede tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for project 0b789cb75bc24a898888246a7745537e. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:04:08.103708 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-f24b6260-0cfa-4a2d-81a7-1e41ae567ede tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for user 27653498cd0a4e089f1cbc43470182ee and project 0b789cb75bc24a898888246a7745537e. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:04:08.127615 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f24b6260-0cfa-4a2d-81a7-1e41ae567ede tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106863 Sep 01 15:04:08.128313 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 331/667] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 1 15:04:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:08.445061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:08.448606 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:08.456250 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:08.456856 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:08.457399 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:08.458442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:08.459013 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:08.459924 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:08.661424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:08.671618 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:08.673501 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:08.674994 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b8c5fe59-fcfd-4adc-a6c1-c3c1ec28aa7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.234353 Sep 01 15:04:08.675966 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 337/668] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:08 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:08.729903 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-95fdfc4d-9af4-4256-8102-085bedba7485 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:08.731790 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-95fdfc4d-9af4-4256-8102-085bedba7485 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:08.740402 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95fdfc4d-9af4-4256-8102-085bedba7485 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:08.740973 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95fdfc4d-9af4-4256-8102-085bedba7485 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:08.741558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95fdfc4d-9af4-4256-8102-085bedba7485 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:08.742519 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95fdfc4d-9af4-4256-8102-085bedba7485 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:08.743591 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95fdfc4d-9af4-4256-8102-085bedba7485 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:08.744337 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95fdfc4d-9af4-4256-8102-085bedba7485 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:08.967921 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-95fdfc4d-9af4-4256-8102-085bedba7485 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:08.976034 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-95fdfc4d-9af4-4256-8102-085bedba7485 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1259 microversion: 2.1 time: 0.250120 Sep 01 15:04:08.976608 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 332/669] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:08 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:09.606719 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2077693228", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf8cd5c2-fc41-47d1-b1ef-d6d4b64d51b6"}], "security_groups": [{"name": "tempest-securitygroup--399655270"}], "key_name": "tempest-keypair-127803300", "user_data": "}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:09.702341 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:09.703360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:09.712850 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:09.713594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:09.714402 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:09.715464 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:09.716089 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:09.716895 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:09.730277 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.network.neutron [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] validate_networks() for [('bf8cd5c2-fc41-47d1-b1ef-d6d4b64d51b6', None, None, None, None, None)] {{(pid=120553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:04:09.880032 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:09.889941 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:09.891729 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:09.893638 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-8f2b2063-f4e3-4c45-ae8d-df8bac5584db tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.199028 Sep 01 15:04:09.894803 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 333/670] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:09 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:04:10.000034 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-72a10fc6-dc40-4f33-9dc4-ada1a861595d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:10.000902 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-72a10fc6-dc40-4f33-9dc4-ada1a861595d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:10.019136 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72a10fc6-dc40-4f33-9dc4-ada1a861595d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:10.019875 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72a10fc6-dc40-4f33-9dc4-ada1a861595d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:10.020516 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72a10fc6-dc40-4f33-9dc4-ada1a861595d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:10.021216 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72a10fc6-dc40-4f33-9dc4-ada1a861595d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:10.021826 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72a10fc6-dc40-4f33-9dc4-ada1a861595d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:10.022450 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-72a10fc6-dc40-4f33-9dc4-ada1a861595d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:10.155543 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Flavor limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:04:10.156117 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Image limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:04:10.156996 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Flavor pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:04:10.157194 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Image pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:04:10.157707 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:04:10.170221 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:10.171795 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:10.172721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:10.173813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:10.174544 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:10.175128 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:10.189213 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-72a10fc6-dc40-4f33-9dc4-ada1a861595d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:10.198311 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-72a10fc6-dc40-4f33-9dc4-ada1a861595d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1443 microversion: 2.1 time: 0.202058 Sep 01 15:04:10.199192 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 334/671] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:09 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1443 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:04:10.204466 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for project 0b789cb75bc24a898888246a7745537e. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:04:10.208411 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for user 27653498cd0a4e089f1cbc43470182ee and project 0b789cb75bc24a898888246a7745537e. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:04:10.218523 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4bc7097a-c700-4965-907c-c23c97b9ebef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:10.219374 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4bc7097a-c700-4965-907c-c23c97b9ebef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:10.219747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Going to run 1 instances... {{(pid=120553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:04:10.222292 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:04:10.225498 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4bc7097a-c700-4965-907c-c23c97b9ebef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:10.225986 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4bc7097a-c700-4965-907c-c23c97b9ebef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:10.226456 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4bc7097a-c700-4965-907c-c23c97b9ebef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:10.227286 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4bc7097a-c700-4965-907c-c23c97b9ebef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:10.227742 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4bc7097a-c700-4965-907c-c23c97b9ebef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:10.228167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4bc7097a-c700-4965-907c-c23c97b9ebef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:10.275195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7d59eff7-4159-43cb-9430-eb61fe1f6582 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.673697 Sep 01 15:04:10.276178 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 338/672] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:04:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:04:10.297129 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cf816b5a-f22b-4ed0-b749-f430e6dc602b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:10.299036 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-cf816b5a-f22b-4ed0-b749-f430e6dc602b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:10.412672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-cf816b5a-f22b-4ed0-b749-f430e6dc602b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:10.421333 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cf816b5a-f22b-4ed0-b749-f430e6dc602b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1241 microversion: 2.1 time: 0.137786 Sep 01 15:04:10.426993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4bc7097a-c700-4965-907c-c23c97b9ebef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:10.436072 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 339/673] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:10 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1241 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:10.439757 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4bc7097a-c700-4965-907c-c23c97b9ebef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1443 microversion: 2.1 time: 0.224476 Sep 01 15:04:10.440802 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 335/674] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:10 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1443 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:04:10.917719 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:10.918451 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:10.925492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:10.925997 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:10.926515 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:10.927500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:10.927973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:10.928409 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:11.116784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:11.127032 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:11.129141 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:11.130578 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-70f27dae-d33b-434a-862f-d91c549a3689 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.217315 Sep 01 15:04:11.132172 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 340/675] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:10 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:04:11.442307 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-91bee807-7fdd-4c7a-b057-2db4e6d1a97f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:11.442934 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-91bee807-7fdd-4c7a-b057-2db4e6d1a97f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:11.450336 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91bee807-7fdd-4c7a-b057-2db4e6d1a97f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:11.451168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91bee807-7fdd-4c7a-b057-2db4e6d1a97f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:11.451616 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91bee807-7fdd-4c7a-b057-2db4e6d1a97f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:11.452320 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91bee807-7fdd-4c7a-b057-2db4e6d1a97f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:11.452947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91bee807-7fdd-4c7a-b057-2db4e6d1a97f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:11.453376 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91bee807-7fdd-4c7a-b057-2db4e6d1a97f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:11.533568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-91bee807-7fdd-4c7a-b057-2db4e6d1a97f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:11.546483 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-91bee807-7fdd-4c7a-b057-2db4e6d1a97f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1293 microversion: 2.1 time: 0.107931 Sep 01 15:04:11.547900 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 336/676] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:11 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:12.156916 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:12.157629 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:12.166218 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:12.166742 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:12.167362 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:12.168063 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:12.168522 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:12.168966 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:12.397417 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:12.438395 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:12.440803 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:12.444028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-25440012-e55b-43d2-82b7-ea4eae405057 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.292019 Sep 01 15:04:12.444858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 341/677] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:12 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:12.569700 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d526bdc3-2c3d-4411-8f89-18e835032aac tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:12.570442 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d526bdc3-2c3d-4411-8f89-18e835032aac tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:12.583959 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d526bdc3-2c3d-4411-8f89-18e835032aac tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:12.584739 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d526bdc3-2c3d-4411-8f89-18e835032aac tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:12.587454 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d526bdc3-2c3d-4411-8f89-18e835032aac tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:12.588267 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d526bdc3-2c3d-4411-8f89-18e835032aac tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:12.588717 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d526bdc3-2c3d-4411-8f89-18e835032aac tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:12.589354 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d526bdc3-2c3d-4411-8f89-18e835032aac tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:12.804982 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d526bdc3-2c3d-4411-8f89-18e835032aac tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:12.812928 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d526bdc3-2c3d-4411-8f89-18e835032aac tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1366 microversion: 2.1 time: 0.247333 Sep 01 15:04:12.813851 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 337/678] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:12 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:12.875346 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-ed183f1f-539e-43eb-8cde-a557b25c1a28 req-12acf808-69b5-460c-8c5b-46e09201a2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a", "tag": "ee2ec77e-7de7-43b9-b302-bffde8d5f382"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:12.886055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-ed183f1f-539e-43eb-8cde-a557b25c1a28 req-12acf808-69b5-460c-8c5b-46e09201a2e9 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:12.886577 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-ed183f1f-539e-43eb-8cde-a557b25c1a28 req-12acf808-69b5-460c-8c5b-46e09201a2e9 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:12.887012 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-ed183f1f-539e-43eb-8cde-a557b25c1a28 req-12acf808-69b5-460c-8c5b-46e09201a2e9 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:12.898832 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-ed183f1f-539e-43eb-8cde-a557b25c1a28 req-12acf808-69b5-460c-8c5b-46e09201a2e9 service nova] Creating event network-changed:ee2ec77e-7de7-43b9-b302-bffde8d5f382 for instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a on hv-cinder-85505 Sep 01 15:04:12.904803 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-ed183f1f-539e-43eb-8cde-a557b25c1a28 req-12acf808-69b5-460c-8c5b-46e09201a2e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110143 Sep 01 15:04:12.905687 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 342/679] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:04:13.234406 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-fb039043-1302-4a25-b63a-7107a2a9b290 req-957d899b-f838-42ab-967d-1c91210d8b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550286be-d749-4dff-9def-2d2a3bb0a283", "tag": "f3c5bb5e-6c48-417b-b600-221425800d79"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:13.242024 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:13.247197 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-fb039043-1302-4a25-b63a-7107a2a9b290 req-957d899b-f838-42ab-967d-1c91210d8b51 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:13.247931 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-fb039043-1302-4a25-b63a-7107a2a9b290 req-957d899b-f838-42ab-967d-1c91210d8b51 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:13.248581 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-fb039043-1302-4a25-b63a-7107a2a9b290 req-957d899b-f838-42ab-967d-1c91210d8b51 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:13.261543 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-fb039043-1302-4a25-b63a-7107a2a9b290 req-957d899b-f838-42ab-967d-1c91210d8b51 service nova] Creating event network-changed:f3c5bb5e-6c48-417b-b600-221425800d79 for instance 550286be-d749-4dff-9def-2d2a3bb0a283 on hv-cinder-85505 Sep 01 15:04:13.267875 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-fb039043-1302-4a25-b63a-7107a2a9b290 req-957d899b-f838-42ab-967d-1c91210d8b51 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036974 Sep 01 15:04:13.269318 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 338/680] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:13.472993 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:13.473726 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:13.480117 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:13.480796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:13.481389 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:13.482282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:13.482919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:13.483427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:13.725500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:13.735395 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:13.737172 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:13.738801 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-adfceff5-1234-4040-a3f8-5a205d945e0f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.270702 Sep 01 15:04:13.739623 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 343/681] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:13 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:13.835881 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f15109d2-e485-4268-b9c7-9ca6be0a36a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:13.836668 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f15109d2-e485-4268-b9c7-9ca6be0a36a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:13.844799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f15109d2-e485-4268-b9c7-9ca6be0a36a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:13.845293 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f15109d2-e485-4268-b9c7-9ca6be0a36a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:13.845737 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f15109d2-e485-4268-b9c7-9ca6be0a36a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:13.846470 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f15109d2-e485-4268-b9c7-9ca6be0a36a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:13.846935 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f15109d2-e485-4268-b9c7-9ca6be0a36a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:13.847370 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f15109d2-e485-4268-b9c7-9ca6be0a36a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:13.987631 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f15109d2-e485-4268-b9c7-9ca6be0a36a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:13.995332 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f15109d2-e485-4268-b9c7-9ca6be0a36a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1366 microversion: 2.1 time: 0.163999 Sep 01 15:04:13.995896 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 339/682] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:13 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:14.763879 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:14.764542 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:14.770921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:14.771414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:14.771849 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:14.772534 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:14.772986 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:14.773410 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:14.975754 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:14.986643 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:14.988207 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:14.989496 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-24d478e4-4edb-47e1-950a-f9b40ccd350f tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.229479 Sep 01 15:04:14.990154 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 344/683] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:14 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:15.017035 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-709bcd2c-fd5f-403d-afc3-355ea2948557 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:15.017662 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-709bcd2c-fd5f-403d-afc3-355ea2948557 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:15.024989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-709bcd2c-fd5f-403d-afc3-355ea2948557 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:15.025486 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-709bcd2c-fd5f-403d-afc3-355ea2948557 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:15.025933 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-709bcd2c-fd5f-403d-afc3-355ea2948557 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:15.026677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-709bcd2c-fd5f-403d-afc3-355ea2948557 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:15.027144 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-709bcd2c-fd5f-403d-afc3-355ea2948557 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:15.027576 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-709bcd2c-fd5f-403d-afc3-355ea2948557 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:15.157230 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-709bcd2c-fd5f-403d-afc3-355ea2948557 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:15.165720 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-709bcd2c-fd5f-403d-afc3-355ea2948557 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1366 microversion: 2.1 time: 0.153500 Sep 01 15:04:15.166447 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 340/684] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:15 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:16.014490 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:16.015132 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:16.021733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:16.022166 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:16.022631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:16.023336 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:16.024455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:16.024881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:16.155285 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:16.163368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:16.164858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:16.166001 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8309bf32-90a6-46c3-afa5-bd255ac666c4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1744 microversion: 2.20 time: 0.155415 Sep 01 15:04:16.166589 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 345/685] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:16 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:16.186892 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-06affab3-faab-4a0a-b29d-2262f69f132b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:16.187513 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-06affab3-faab-4a0a-b29d-2262f69f132b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:16.193896 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-06affab3-faab-4a0a-b29d-2262f69f132b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:16.194427 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-06affab3-faab-4a0a-b29d-2262f69f132b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:16.194869 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-06affab3-faab-4a0a-b29d-2262f69f132b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:16.196120 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-06affab3-faab-4a0a-b29d-2262f69f132b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:16.196579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-06affab3-faab-4a0a-b29d-2262f69f132b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:16.197006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-06affab3-faab-4a0a-b29d-2262f69f132b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:16.325364 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-06affab3-faab-4a0a-b29d-2262f69f132b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:16.333261 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-06affab3-faab-4a0a-b29d-2262f69f132b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1366 microversion: 2.1 time: 0.150072 Sep 01 15:04:16.333825 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 341/686] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:16 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:17.188887 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:17.189655 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:17.196825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:17.197318 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:17.197763 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:17.198495 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:17.198962 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:17.199402 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:17.325274 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:17.333579 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:17.335212 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:17.336394 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8d3a1ed5-7613-4d88-8795-86ff7a4c6860 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1744 microversion: 2.20 time: 0.151398 Sep 01 15:04:17.336959 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 346/687] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:17 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:17.354840 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-173ad1c1-a00c-4abe-8df0-a862c1f49f68 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:17.355566 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-173ad1c1-a00c-4abe-8df0-a862c1f49f68 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:17.361922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-173ad1c1-a00c-4abe-8df0-a862c1f49f68 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:17.362665 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-173ad1c1-a00c-4abe-8df0-a862c1f49f68 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:17.363323 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-173ad1c1-a00c-4abe-8df0-a862c1f49f68 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:17.364091 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-173ad1c1-a00c-4abe-8df0-a862c1f49f68 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:17.364625 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-173ad1c1-a00c-4abe-8df0-a862c1f49f68 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:17.365265 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-173ad1c1-a00c-4abe-8df0-a862c1f49f68 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:17.497749 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-173ad1c1-a00c-4abe-8df0-a862c1f49f68 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:17.505664 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-173ad1c1-a00c-4abe-8df0-a862c1f49f68 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1366 microversion: 2.1 time: 0.155239 Sep 01 15:04:17.506340 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 342/688] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:17 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:17.790355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-980ad621-81ed-46d9-92ff-09fd8d66b3c3 req-6b6dc8e9-0d36-410d-8b41-103777a31774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550286be-d749-4dff-9def-2d2a3bb0a283", "name": "network-vif-plugged", "status": "completed", "tag": "f3c5bb5e-6c48-417b-b600-221425800d79"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:17.795367 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:17.802189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-980ad621-81ed-46d9-92ff-09fd8d66b3c3 req-6b6dc8e9-0d36-410d-8b41-103777a31774 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:17.803352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-980ad621-81ed-46d9-92ff-09fd8d66b3c3 req-6b6dc8e9-0d36-410d-8b41-103777a31774 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:17.803987 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-980ad621-81ed-46d9-92ff-09fd8d66b3c3 req-6b6dc8e9-0d36-410d-8b41-103777a31774 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:17.819147 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-980ad621-81ed-46d9-92ff-09fd8d66b3c3 req-6b6dc8e9-0d36-410d-8b41-103777a31774 service nova] Creating event network-vif-plugged:f3c5bb5e-6c48-417b-b600-221425800d79 for instance 550286be-d749-4dff-9def-2d2a3bb0a283 on hv-cinder-85505 Sep 01 15:04:17.824219 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-980ad621-81ed-46d9-92ff-09fd8d66b3c3 req-6b6dc8e9-0d36-410d-8b41-103777a31774 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100213 Sep 01 15:04:17.824803 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 347/689] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:18.358330 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:18.359007 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:18.361350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=4 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:18.368159 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:18.368650 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:18.369086 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:18.369782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:18.370442 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:18.370872 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:18.510882 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:18.520126 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:18.526775 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9bab916f-ad0c-42c1-b063-5a65d1698483 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:18.527571 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9bab916f-ad0c-42c1-b063-5a65d1698483 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:18.534572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9bab916f-ad0c-42c1-b063-5a65d1698483 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:18.535897 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:18.537610 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-340a69e6-b596-4dda-bc7a-9ab1daccbd8d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1739 microversion: 2.20 time: 0.183193 Sep 01 15:04:18.538353 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 343/690] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:18 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:18.539240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9bab916f-ad0c-42c1-b063-5a65d1698483 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:18.539888 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9bab916f-ad0c-42c1-b063-5a65d1698483 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:18.540610 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9bab916f-ad0c-42c1-b063-5a65d1698483 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:18.541068 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9bab916f-ad0c-42c1-b063-5a65d1698483 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:18.541492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9bab916f-ad0c-42c1-b063-5a65d1698483 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:18.552781 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=100 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:18.725146 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9bab916f-ad0c-42c1-b063-5a65d1698483 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:18.733287 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9bab916f-ad0c-42c1-b063-5a65d1698483 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1366 microversion: 2.1 time: 0.210547 Sep 01 15:04:18.733849 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 348/691] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:18 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:19.563623 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:19.566985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:19.576011 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:19.576191 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:19.576765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:19.577603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:19.578139 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:19.578681 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:19.753607 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:19.754961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-632489a0-a08f-46f9-a254-d7e4e44a6d26 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:19.755705 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-632489a0-a08f-46f9-a254-d7e4e44a6d26 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:19.762445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-632489a0-a08f-46f9-a254-d7e4e44a6d26 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:19.763213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-632489a0-a08f-46f9-a254-d7e4e44a6d26 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:19.763853 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-632489a0-a08f-46f9-a254-d7e4e44a6d26 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:19.764901 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-632489a0-a08f-46f9-a254-d7e4e44a6d26 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:19.765518 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-632489a0-a08f-46f9-a254-d7e4e44a6d26 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:19.766144 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-632489a0-a08f-46f9-a254-d7e4e44a6d26 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:19.767842 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:19.773126 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:19.773126 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-827e783f-f744-4271-82f6-5bea3bad8b66 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1739 microversion: 2.20 time: 0.214899 Sep 01 15:04:19.773126 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 344/692] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:19 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:19.868191 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-3766ab87-7ba7-40ab-af92-bafe80328b2e req-e0ab6346-fbc2-41fd-97d4-43a666effeba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea0e09a-fcb0-4aab-844d-c9b7d170ec95", "name": "network-vif-plugged", "status": "completed", "tag": "2c6c7ac6-7b01-495d-911b-2cf5b78b8904"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:19.899676 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3766ab87-7ba7-40ab-af92-bafe80328b2e req-e0ab6346-fbc2-41fd-97d4-43a666effeba service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:19.900178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3766ab87-7ba7-40ab-af92-bafe80328b2e req-e0ab6346-fbc2-41fd-97d4-43a666effeba service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:19.900617 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3766ab87-7ba7-40ab-af92-bafe80328b2e req-e0ab6346-fbc2-41fd-97d4-43a666effeba service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:19.921743 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=100 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:19.927927 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-3766ab87-7ba7-40ab-af92-bafe80328b2e req-e0ab6346-fbc2-41fd-97d4-43a666effeba service nova] Creating event network-vif-plugged:2c6c7ac6-7b01-495d-911b-2cf5b78b8904 for instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 on hv-cinder-85505 Sep 01 15:04:19.934868 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-3766ab87-7ba7-40ab-af92-bafe80328b2e req-e0ab6346-fbc2-41fd-97d4-43a666effeba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071260 Sep 01 15:04:19.936060 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 345/693] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:19.955231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-632489a0-a08f-46f9-a254-d7e4e44a6d26 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:19.964430 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-632489a0-a08f-46f9-a254-d7e4e44a6d26 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1366 microversion: 2.1 time: 0.214566 Sep 01 15:04:19.965231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 349/694] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:19 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:04:20.801324 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:20.802038 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:20.812178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:20.813048 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:20.813787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:20.815226 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:20.815703 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:20.816140 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:20.970853 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:20.979963 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:20.981308 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:20.982606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-65be01c0-1d77-4bf8-b1ff-f319b171cf78 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1739 microversion: 2.20 time: 0.186735 Sep 01 15:04:20.983470 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 346/695] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:20 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:20.987717 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e92c80f8-8b42-427c-b626-96b61a7000a7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:20.988919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e92c80f8-8b42-427c-b626-96b61a7000a7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:20.995297 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:20.996352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=8 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:20.999370 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e92c80f8-8b42-427c-b626-96b61a7000a7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:21.000127 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e92c80f8-8b42-427c-b626-96b61a7000a7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:21.000925 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e92c80f8-8b42-427c-b626-96b61a7000a7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:21.002053 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e92c80f8-8b42-427c-b626-96b61a7000a7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:21.002717 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e92c80f8-8b42-427c-b626-96b61a7000a7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:21.003553 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e92c80f8-8b42-427c-b626-96b61a7000a7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:21.150197 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e92c80f8-8b42-427c-b626-96b61a7000a7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:21.159145 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e92c80f8-8b42-427c-b626-96b61a7000a7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1556 microversion: 2.1 time: 0.176211 Sep 01 15:04:21.160574 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 350/696] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:04:20 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:04:21.183077 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-08bc1bd6-5e33-4742-953c-eb10b20ebbc6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:21.183717 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-08bc1bd6-5e33-4742-953c-eb10b20ebbc6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:21.190483 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08bc1bd6-5e33-4742-953c-eb10b20ebbc6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:21.190948 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08bc1bd6-5e33-4742-953c-eb10b20ebbc6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:21.191483 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08bc1bd6-5e33-4742-953c-eb10b20ebbc6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:21.192274 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08bc1bd6-5e33-4742-953c-eb10b20ebbc6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:21.192798 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08bc1bd6-5e33-4742-953c-eb10b20ebbc6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:21.193285 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-08bc1bd6-5e33-4742-953c-eb10b20ebbc6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:21.286478 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-08bc1bd6-5e33-4742-953c-eb10b20ebbc6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107908 Sep 01 15:04:21.287599 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 347/697] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 1 15:04:21 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:22.008878 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:22.009505 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:22.018319 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:22.019220 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:22.019916 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:22.021151 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:22.021886 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:22.022577 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:22.195246 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:22.204502 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:22.206268 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:22.207432 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-21dd2cb2-a698-48d0-b68c-9ce2a21970ab tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1739 microversion: 2.20 time: 0.203180 Sep 01 15:04:22.221882 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 351/698] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:22 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:22.529918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-b9fcd460-2913-44e4-90a3-e78a2b722a9e req-ede326b8-3baf-45d7-8879-c882756c523a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550286be-d749-4dff-9def-2d2a3bb0a283", "tag": "f3c5bb5e-6c48-417b-b600-221425800d79"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:22.541016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b9fcd460-2913-44e4-90a3-e78a2b722a9e req-ede326b8-3baf-45d7-8879-c882756c523a service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:22.541818 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b9fcd460-2913-44e4-90a3-e78a2b722a9e req-ede326b8-3baf-45d7-8879-c882756c523a service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:22.542496 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b9fcd460-2913-44e4-90a3-e78a2b722a9e req-ede326b8-3baf-45d7-8879-c882756c523a service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:22.555265 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-b9fcd460-2913-44e4-90a3-e78a2b722a9e req-ede326b8-3baf-45d7-8879-c882756c523a service nova] Creating event network-changed:f3c5bb5e-6c48-417b-b600-221425800d79 for instance 550286be-d749-4dff-9def-2d2a3bb0a283 on hv-cinder-85505 Sep 01 15:04:22.560504 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-b9fcd460-2913-44e4-90a3-e78a2b722a9e req-ede326b8-3baf-45d7-8879-c882756c523a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034867 Sep 01 15:04:22.565373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 348/699] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:23.232612 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:23.233415 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:23.240585 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:23.241402 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:23.241950 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:23.243318 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:23.243884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:23.244422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:23.408607 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:23.419366 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:23.420869 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:23.422411 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-98d2a9c8-19be-4efd-8423-1dfc1558ddc0 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1739 microversion: 2.20 time: 0.194240 Sep 01 15:04:23.422988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 352/700] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:23 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:24.447706 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:24.450522 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:24.456737 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:24.457224 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:24.457658 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:24.458371 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:24.459055 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:24.459824 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:24.614310 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:24.624194 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:24.625910 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:24.627325 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-39769c29-2e83-4d5c-ac1b-868a6d0b1515 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1739 microversion: 2.20 time: 0.185706 Sep 01 15:04:24.627883 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 349/701] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:24 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:25.651292 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:25.652622 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:25.660602 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:25.661427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:25.662375 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:25.663386 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:25.665254 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:25.665922 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:25.816697 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:25.825406 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:25.826906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:25.830882 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8636c788-eb3e-4053-b6f3-83c37a572a00 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1739 microversion: 2.20 time: 0.183533 Sep 01 15:04:25.832351 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 353/702] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:25 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:26.853605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:26.854347 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:26.860611 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:26.861135 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:26.861675 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:26.862459 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:26.862914 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:26.863338 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:26.992803 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:27.000805 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:27.002221 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:27.003391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c670f2b5-43f1-44a3-b21a-f0c6c5a1549a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1739 microversion: 2.20 time: 0.153632 Sep 01 15:04:27.003943 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 350/703] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:26 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:28.027333 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:28.027952 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:28.034333 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:28.034821 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:28.035265 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:28.035961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:28.036423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:28.036863 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:28.216122 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:28.225085 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:28.226566 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:28.227903 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4c9f64b7-7583-49d2-a297-2b3aa5dcad41 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1721 microversion: 2.20 time: 0.205082 Sep 01 15:04:28.228572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 354/704] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:28 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:29.251448 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:29.252057 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:29.259190 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:29.259671 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:29.260101 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:29.260811 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:29.261243 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:29.261679 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:29.393516 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:29.401577 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:29.403051 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:29.404214 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0011633f-b165-4b4c-8860-7994b820df3d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1721 microversion: 2.20 time: 0.156768 Sep 01 15:04:29.404777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 351/705] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:29 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:30.427730 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:30.428345 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:30.435285 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:30.435766 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:30.436208 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:30.436923 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:30.437380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:30.437808 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:30.571256 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:30.579534 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:30.580972 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:30.582136 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1e53c466-6d86-44c3-a1a2-d7f391990e99 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1724 microversion: 2.20 time: 0.158306 Sep 01 15:04:30.582724 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 355/706] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:30 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:30.604847 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-deaa725c-fb8a-443c-83f5-f23ca17790ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61d3be5e-026d-42da-ac35-95e08f9ca5bb"}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:30.607211 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-deaa725c-fb8a-443c-83f5-f23ca17790ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:30.613598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-deaa725c-fb8a-443c-83f5-f23ca17790ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:30.614080 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-deaa725c-fb8a-443c-83f5-f23ca17790ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:30.614561 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-deaa725c-fb8a-443c-83f5-f23ca17790ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:30.615249 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-deaa725c-fb8a-443c-83f5-f23ca17790ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:30.615709 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-deaa725c-fb8a-443c-83f5-f23ca17790ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:30.616135 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-deaa725c-fb8a-443c-83f5-f23ca17790ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:30.878643 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-deaa725c-fb8a-443c-83f5-f23ca17790ca tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "POST /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.278289 Sep 01 15:04:30.879217 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 352/707] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Sep 1 15:04:30 2022] POST /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/os-volume_attachments => generated 188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 15:04:30.997431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d15eba56-1624-4d2e-b046-f35462f92932 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:30.997924 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d15eba56-1624-4d2e-b046-f35462f92932 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:31.003811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d15eba56-1624-4d2e-b046-f35462f92932 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:31.004294 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d15eba56-1624-4d2e-b046-f35462f92932 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:31.004726 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d15eba56-1624-4d2e-b046-f35462f92932 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:31.005403 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d15eba56-1624-4d2e-b046-f35462f92932 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:31.005855 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d15eba56-1624-4d2e-b046-f35462f92932 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:31.006311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d15eba56-1624-4d2e-b046-f35462f92932 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:31.240548 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d15eba56-1624-4d2e-b046-f35462f92932 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/os-volume_attachments/61d3be5e-026d-42da-ac35-95e08f9ca5bb" status: 202 len: 0 microversion: 2.20 time: 0.246956 Sep 01 15:04:31.241139 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 356/708] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Sep 1 15:04:30 2022] DELETE /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/os-volume_attachments/61d3be5e-026d-42da-ac35-95e08f9ca5bb => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:04:31.299262 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4aa6c6d1-97da-4b44-8eef-f63fac46f3bd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:31.299793 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4aa6c6d1-97da-4b44-8eef-f63fac46f3bd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:31.306224 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4aa6c6d1-97da-4b44-8eef-f63fac46f3bd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:31.306740 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4aa6c6d1-97da-4b44-8eef-f63fac46f3bd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:31.307177 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4aa6c6d1-97da-4b44-8eef-f63fac46f3bd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:31.307862 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4aa6c6d1-97da-4b44-8eef-f63fac46f3bd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:31.308315 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4aa6c6d1-97da-4b44-8eef-f63fac46f3bd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:31.308741 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4aa6c6d1-97da-4b44-8eef-f63fac46f3bd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:31.350268 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4aa6c6d1-97da-4b44-8eef-f63fac46f3bd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120554) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 15:04:31.414604 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4aa6c6d1-97da-4b44-8eef-f63fac46f3bd tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "POST /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/action" status: 202 len: 0 microversion: 2.20 time: 0.119488 Sep 01 15:04:31.415198 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 353/709] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Sep 1 15:04:31 2022] POST /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:04:31.423641 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:31.424324 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:31.431463 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:31.431989 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:31.432376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:31.433104 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:31.433647 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:31.434110 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:31.559136 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-6b9ec197-16e2-4aa5-b758-9be265298136 req-c95ddd63-29d7-478e-b03a-3d4d8e69e37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea0e09a-fcb0-4aab-844d-c9b7d170ec95", "name": "network-vif-unplugged", "status": "completed", "tag": "2c6c7ac6-7b01-495d-911b-2cf5b78b8904"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:31.568545 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-6b9ec197-16e2-4aa5-b758-9be265298136 req-c95ddd63-29d7-478e-b03a-3d4d8e69e37e service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:31.569036 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-6b9ec197-16e2-4aa5-b758-9be265298136 req-c95ddd63-29d7-478e-b03a-3d4d8e69e37e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:31.569467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-6b9ec197-16e2-4aa5-b758-9be265298136 req-c95ddd63-29d7-478e-b03a-3d4d8e69e37e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:31.583099 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.compute.server_external_events [req-6b9ec197-16e2-4aa5-b758-9be265298136 req-c95ddd63-29d7-478e-b03a-3d4d8e69e37e service nova] Unable to find a host for instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95. Dropping event network-vif-unplugged {{(pid=120554) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 15:04:31.583970 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-6b9ec197-16e2-4aa5-b758-9be265298136 req-c95ddd63-29d7-478e-b03a-3d4d8e69e37e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029935 Sep 01 15:04:31.584847 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 354/710] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 01 15:04:31.590622 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:31.598967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:31.602138 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:31.603632 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-145f84a3-89d7-4bcf-a3d9-460ec6beb04d tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1672 microversion: 2.20 time: 0.184017 Sep 01 15:04:31.604635 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 357/711] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:31 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:32.627210 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:32.627748 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:32.634366 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:32.634862 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:32.635302 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:32.636072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:32.636529 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:32.636984 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:32.770440 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:32.778605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:32.780074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:32.781236 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-82055cc5-c387-4272-a318-28c3bf82a597 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.158381 Sep 01 15:04:32.781796 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 355/712] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:32 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:33.803919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:33.804532 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:33.810473 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:33.810953 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:33.811407 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:33.812052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:33.812508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:33.812930 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:33.962634 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:33.971673 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:33.973522 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:33.975021 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-bb6b49a7-161d-4da1-8175-7055eaa1d736 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.175141 Sep 01 15:04:33.976791 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 358/713] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:33 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:35.001001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:35.001536 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:35.008880 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:35.009362 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:35.009803 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:35.010589 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:35.011046 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:35.011469 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:35.147260 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:35.157094 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:35.158602 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:35.159810 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d6136489-a825-4823-aea8-5552e357a48c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.162743 Sep 01 15:04:35.160368 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 356/714] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:34 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 15:04:36.184208 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:36.184208 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:36.190988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:36.191545 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:36.192096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:36.192855 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:36.193373 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:36.193802 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:36.328082 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:36.336764 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:36.338218 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:36.339630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1b25d583-57c7-4bb9-94ee-2ca7f02d497a tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.160727 Sep 01 15:04:36.340213 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 359/715] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:36 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:37.362873 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:37.363654 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:37.370607 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:37.371102 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:37.371552 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:37.372265 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:37.372729 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:37.373164 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:37.514284 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:37.523420 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:37.524886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:37.526039 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-eecf8889-4f47-49c7-a7bb-a586dfe4953b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.167122 Sep 01 15:04:37.526637 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 357/716] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:37 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:38.552162 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:38.552996 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:38.560312 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:38.560797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:38.561252 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:38.561983 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:38.562561 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:38.562986 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:38.708711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:38.717694 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:38.719146 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:38.720311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c4b582f5-ad43-4b28-9995-6d70affa4080 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.172499 Sep 01 15:04:38.720867 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 360/717] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:38 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:39.744495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:39.745212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:39.751842 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:39.752331 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:39.752771 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:39.753472 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:39.753928 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:39.754385 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:39.897113 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:39.906060 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:39.907546 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:39.908721 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2066730f-cd84-41e5-8637-6f481dc729f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.168261 Sep 01 15:04:39.909279 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 358/718] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:39 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:40.933728 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:40.934433 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:40.941698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:40.942301 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:40.942818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:40.943597 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:40.944128 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:40.944624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:41.083985 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:41.092727 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:41.094176 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:41.095363 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-28fe77b4-1c70-41be-85da-ba26f52e3bc4 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.166190 Sep 01 15:04:41.096107 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 361/719] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:40 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:42.118573 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:42.119710 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:42.126284 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:42.126776 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:42.127211 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:42.127906 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:42.128372 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:42.128782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:42.270293 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:42.279438 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:42.280372 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:42.281693 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-32dab594-889a-453f-b38f-b8fbc563282b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.166978 Sep 01 15:04:42.294584 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 359/720] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:42 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:43.304189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:43.304903 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:43.311629 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:43.312130 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:43.312566 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:43.313252 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:43.313704 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:43.314130 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:43.329395 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:43.448542 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:43.456620 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:43.458120 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:43.459316 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f8f026c4-514f-422b-9e20-59ff1206de8c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.159383 Sep 01 15:04:43.459877 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 362/721] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:43 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:44.483038 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:44.483574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:44.486032 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:44.491260 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:44.491737 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:44.492169 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:44.492848 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:44.493310 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:44.493732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:44.513212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:44.629909 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:44.638392 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:44.639846 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:44.640990 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e052f1a3-d1fd-4b00-9f7d-c65eb097b732 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.162659 Sep 01 15:04:44.641537 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 360/722] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:44 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:45.664656 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:45.665225 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:45.672545 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:45.673041 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:45.673493 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:45.674603 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:45.675600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:45.675600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:45.816444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:45.824812 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:45.826291 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:45.827462 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2857a356-fb17-4c11-9e6a-b2fee767e6f6 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.167053 Sep 01 15:04:45.828022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 363/723] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:45 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:46.850041 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:46.850697 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:46.857732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:46.858221 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:46.858690 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:46.859389 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:46.859853 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:46.860287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:46.986905 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:46.994865 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:46.996683 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:46.997824 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-454ce0e9-8b29-4383-a021-2c9bb11cc371 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.151792 Sep 01 15:04:46.998416 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 361/724] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:46 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:47.675282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-ec8c1d1f-6a05-44b2-bbbd-52746656a1cb req-d296f69b-594a-437e-985d-6fad664d6aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea0e09a-fcb0-4aab-844d-c9b7d170ec95", "name": "network-vif-plugged", "status": "completed", "tag": "2c6c7ac6-7b01-495d-911b-2cf5b78b8904"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:47.688609 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-ec8c1d1f-6a05-44b2-bbbd-52746656a1cb req-d296f69b-594a-437e-985d-6fad664d6aa2 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:47.689178 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-ec8c1d1f-6a05-44b2-bbbd-52746656a1cb req-d296f69b-594a-437e-985d-6fad664d6aa2 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:47.689695 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-ec8c1d1f-6a05-44b2-bbbd-52746656a1cb req-d296f69b-594a-437e-985d-6fad664d6aa2 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:47.700750 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-ec8c1d1f-6a05-44b2-bbbd-52746656a1cb req-d296f69b-594a-437e-985d-6fad664d6aa2 service nova] Creating event network-vif-plugged:2c6c7ac6-7b01-495d-911b-2cf5b78b8904 for instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 on hv-cinder-85505 Sep 01 15:04:47.705795 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-ec8c1d1f-6a05-44b2-bbbd-52746656a1cb req-d296f69b-594a-437e-985d-6fad664d6aa2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034391 Sep 01 15:04:47.706716 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 364/725] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:48.020624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:48.021236 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:48.028089 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:48.028572 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:48.029014 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:48.029709 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:48.030198 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:48.030652 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:48.160635 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:48.169328 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:48.170799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:48.172227 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9fed31e1-4b04-46fd-a9db-380451da40b8 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.155466 Sep 01 15:04:48.172780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 362/726] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:48 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:48.280834 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e28ab982-cbb6-41d7-b06b-f4e42f3868f7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:48.281402 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e28ab982-cbb6-41d7-b06b-f4e42f3868f7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:48.283378 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=36 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:04:48.288804 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e28ab982-cbb6-41d7-b06b-f4e42f3868f7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:48.289323 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e28ab982-cbb6-41d7-b06b-f4e42f3868f7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:48.289717 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e28ab982-cbb6-41d7-b06b-f4e42f3868f7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:48.290551 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e28ab982-cbb6-41d7-b06b-f4e42f3868f7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:48.291006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e28ab982-cbb6-41d7-b06b-f4e42f3868f7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:48.291430 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e28ab982-cbb6-41d7-b06b-f4e42f3868f7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:48.314883 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e28ab982-cbb6-41d7-b06b-f4e42f3868f7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/ips" status: 200 len: 145 microversion: 2.1 time: 0.038729 Sep 01 15:04:48.315432 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 365/727] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 1 15:04:48 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:49.195557 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:49.196153 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:49.202496 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:49.202975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:49.203410 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:49.204103 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:49.204553 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:49.204972 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:49.332952 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:49.341025 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:49.342486 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:49.343644 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5af338d5-bb22-4b60-9952-228cac936cea tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1730 microversion: 2.20 time: 0.151977 Sep 01 15:04:49.344191 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 363/728] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:49 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:49.633948 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-39c0fda0-235f-40b7-a853-81f733582e92 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72cebd5f-dfc8-44c0-927f-dc11eda1b601"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:49.636263 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-39c0fda0-235f-40b7-a853-81f733582e92 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:49.642606 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-39c0fda0-235f-40b7-a853-81f733582e92 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:49.643095 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-39c0fda0-235f-40b7-a853-81f733582e92 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:49.643532 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-39c0fda0-235f-40b7-a853-81f733582e92 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:49.644216 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-39c0fda0-235f-40b7-a853-81f733582e92 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:49.644673 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-39c0fda0-235f-40b7-a853-81f733582e92 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:49.645096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-39c0fda0-235f-40b7-a853-81f733582e92 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:49.898901 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-39c0fda0-235f-40b7-a853-81f733582e92 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "POST /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268623 Sep 01 15:04:49.899703 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 366/729] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:04:49 2022] POST /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:50.366774 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:50.367394 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:50.374513 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:50.374999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:50.375442 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:50.376134 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:50.376597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:50.377027 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:50.503554 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:50.511646 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:50.513762 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:04:50.515042 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4056bb60-b710-4298-a30c-7af9c3ff3c09 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1717 microversion: 2.20 time: 0.152170 Sep 01 15:04:50.515605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 364/730] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:04:50 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:04:56.371458 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4a9b4c7f-feb0-487d-9421-93c4f0f416d7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:56.373741 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4a9b4c7f-feb0-487d-9421-93c4f0f416d7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:56.379917 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9b4c7f-feb0-487d-9421-93c4f0f416d7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:56.380405 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9b4c7f-feb0-487d-9421-93c4f0f416d7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:56.380846 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9b4c7f-feb0-487d-9421-93c4f0f416d7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:56.381541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9b4c7f-feb0-487d-9421-93c4f0f416d7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:56.381998 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9b4c7f-feb0-487d-9421-93c4f0f416d7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:56.382457 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a9b4c7f-feb0-487d-9421-93c4f0f416d7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:56.412253 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4a9b4c7f-feb0-487d-9421-93c4f0f416d7 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 Sep 01 15:04:56.412803 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 367/731] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:04:56 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:56.423453 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ae9c4556-6385-4528-b65e-705252314cf4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:04:56.423947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ae9c4556-6385-4528-b65e-705252314cf4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:56.430362 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ae9c4556-6385-4528-b65e-705252314cf4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:56.430846 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ae9c4556-6385-4528-b65e-705252314cf4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:56.431279 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ae9c4556-6385-4528-b65e-705252314cf4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:56.431964 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ae9c4556-6385-4528-b65e-705252314cf4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:56.432906 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ae9c4556-6385-4528-b65e-705252314cf4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:56.433331 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ae9c4556-6385-4528-b65e-705252314cf4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:56.461728 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ae9c4556-6385-4528-b65e-705252314cf4 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments/72cebd5f-dfc8-44c0-927f-dc11eda1b601" status: 200 len: 194 microversion: 2.1 time: 0.042419 Sep 01 15:04:56.462474 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 365/732] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Sep 1 15:04:56 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments/72cebd5f-dfc8-44c0-927f-dc11eda1b601 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:04:57.779633 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a4f41c0f-7d18-4a67-86c6-e9831a0e3571 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d801e23-7542-4f59-ac5d-2bfe8846b5b5"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:04:57.781980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a4f41c0f-7d18-4a67-86c6-e9831a0e3571 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:04:57.788316 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a4f41c0f-7d18-4a67-86c6-e9831a0e3571 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:57.788884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a4f41c0f-7d18-4a67-86c6-e9831a0e3571 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:57.789328 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a4f41c0f-7d18-4a67-86c6-e9831a0e3571 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:57.790014 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a4f41c0f-7d18-4a67-86c6-e9831a0e3571 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:04:57.790497 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a4f41c0f-7d18-4a67-86c6-e9831a0e3571 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:04:57.790920 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a4f41c0f-7d18-4a67-86c6-e9831a0e3571 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:04:58.023580 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a4f41c0f-7d18-4a67-86c6-e9831a0e3571 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "POST /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247678 Sep 01 15:04:58.024264 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 368/733] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:04:57 2022] POST /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:05:05.547763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e29f24de-88f0-4fbc-ac63-f3eafae6da85 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:05.549969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e29f24de-88f0-4fbc-ac63-f3eafae6da85 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:05.556389 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e29f24de-88f0-4fbc-ac63-f3eafae6da85 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:05.556870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e29f24de-88f0-4fbc-ac63-f3eafae6da85 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:05.557297 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e29f24de-88f0-4fbc-ac63-f3eafae6da85 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:05.557983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e29f24de-88f0-4fbc-ac63-f3eafae6da85 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:05.558461 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e29f24de-88f0-4fbc-ac63-f3eafae6da85 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:05.558885 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e29f24de-88f0-4fbc-ac63-f3eafae6da85 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:05.588250 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e29f24de-88f0-4fbc-ac63-f3eafae6da85 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045220 Sep 01 15:05:05.588779 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 366/734] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:05:05 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:05.743042 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6d39b92a-db33-4b21-b244-8c2906c444f8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:05.743561 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6d39b92a-db33-4b21-b244-8c2906c444f8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:05.749709 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d39b92a-db33-4b21-b244-8c2906c444f8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:05.750199 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d39b92a-db33-4b21-b244-8c2906c444f8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:05.750675 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d39b92a-db33-4b21-b244-8c2906c444f8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:05.751355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d39b92a-db33-4b21-b244-8c2906c444f8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:05.751818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d39b92a-db33-4b21-b244-8c2906c444f8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:05.752244 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6d39b92a-db33-4b21-b244-8c2906c444f8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:05.782436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6d39b92a-db33-4b21-b244-8c2906c444f8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments/72cebd5f-dfc8-44c0-927f-dc11eda1b601" status: 200 len: 194 microversion: 2.1 time: 0.044312 Sep 01 15:05:05.783000 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 369/735] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Sep 1 15:05:05 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments/72cebd5f-dfc8-44c0-927f-dc11eda1b601 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:05.793016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d43a82ab-05a5-43ec-a585-38dfd10c37c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:05.793527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d43a82ab-05a5-43ec-a585-38dfd10c37c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:05.799630 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d43a82ab-05a5-43ec-a585-38dfd10c37c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:05.800114 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d43a82ab-05a5-43ec-a585-38dfd10c37c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:05.800550 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d43a82ab-05a5-43ec-a585-38dfd10c37c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:05.801236 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d43a82ab-05a5-43ec-a585-38dfd10c37c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:05.801686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d43a82ab-05a5-43ec-a585-38dfd10c37c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:05.802111 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d43a82ab-05a5-43ec-a585-38dfd10c37c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:05.884065 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.objects.instance [None req-d43a82ab-05a5-43ec-a585-38dfd10c37c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lazy-loading 'services' on Instance uuid 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 {{(pid=120554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:05:05.954626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d43a82ab-05a5-43ec-a585-38dfd10c37c2 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments/72cebd5f-dfc8-44c0-927f-dc11eda1b601" status: 202 len: 0 microversion: 2.1 time: 0.165356 Sep 01 15:05:05.955191 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 367/736] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:05:05 2022] DELETE /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments/72cebd5f-dfc8-44c0-927f-dc11eda1b601 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:05:06.360672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8f4bee30-5c9f-4642-b3ce-d74419023c7b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:06.361162 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8f4bee30-5c9f-4642-b3ce-d74419023c7b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:06.367466 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8f4bee30-5c9f-4642-b3ce-d74419023c7b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:06.367947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8f4bee30-5c9f-4642-b3ce-d74419023c7b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:06.368380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8f4bee30-5c9f-4642-b3ce-d74419023c7b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:06.369184 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8f4bee30-5c9f-4642-b3ce-d74419023c7b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:06.369515 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8f4bee30-5c9f-4642-b3ce-d74419023c7b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:06.369934 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8f4bee30-5c9f-4642-b3ce-d74419023c7b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:06.392947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8f4bee30-5c9f-4642-b3ce-d74419023c7b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/ips" status: 200 len: 150 microversion: 2.1 time: 0.036061 Sep 01 15:05:06.393491 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 370/737] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 1 15:05:06 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:07.750712 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3c1ec480-d6b2-493e-86a6-4e017e0fc30e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f3e0117-1ea5-49f3-970b-0df92decc413"}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:07.753201 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3c1ec480-d6b2-493e-86a6-4e017e0fc30e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:07.759338 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c1ec480-d6b2-493e-86a6-4e017e0fc30e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:07.759830 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c1ec480-d6b2-493e-86a6-4e017e0fc30e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:07.760264 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c1ec480-d6b2-493e-86a6-4e017e0fc30e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:07.760958 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c1ec480-d6b2-493e-86a6-4e017e0fc30e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:07.761413 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c1ec480-d6b2-493e-86a6-4e017e0fc30e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:07.761841 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c1ec480-d6b2-493e-86a6-4e017e0fc30e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:07.993060 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3c1ec480-d6b2-493e-86a6-4e017e0fc30e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247606 Sep 01 15:05:07.993734 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 368/738] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:05:07 2022] POST /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:08.129081 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8977daa9-e82a-4935-bd29-d330236caf05 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:08.129643 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8977daa9-e82a-4935-bd29-d330236caf05 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:08.135999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8977daa9-e82a-4935-bd29-d330236caf05 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:08.136572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8977daa9-e82a-4935-bd29-d330236caf05 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:08.137082 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8977daa9-e82a-4935-bd29-d330236caf05 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:08.137888 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8977daa9-e82a-4935-bd29-d330236caf05 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:08.138444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8977daa9-e82a-4935-bd29-d330236caf05 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:08.138938 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8977daa9-e82a-4935-bd29-d330236caf05 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:08.170282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8977daa9-e82a-4935-bd29-d330236caf05 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments/0d801e23-7542-4f59-ac5d-2bfe8846b5b5" status: 200 len: 194 microversion: 2.1 time: 0.045115 Sep 01 15:05:08.170870 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 371/739] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Sep 1 15:05:08 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments/0d801e23-7542-4f59-ac5d-2bfe8846b5b5 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:08.182421 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9907190d-ca51-4c7a-8773-56c382d6f8f6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:08.182947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9907190d-ca51-4c7a-8773-56c382d6f8f6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:08.189050 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9907190d-ca51-4c7a-8773-56c382d6f8f6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:08.189542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9907190d-ca51-4c7a-8773-56c382d6f8f6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:08.189986 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9907190d-ca51-4c7a-8773-56c382d6f8f6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:08.190722 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9907190d-ca51-4c7a-8773-56c382d6f8f6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:08.191185 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9907190d-ca51-4c7a-8773-56c382d6f8f6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:08.191617 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9907190d-ca51-4c7a-8773-56c382d6f8f6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:08.271542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.objects.instance [None req-9907190d-ca51-4c7a-8773-56c382d6f8f6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lazy-loading 'services' on Instance uuid 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 {{(pid=120554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:05:08.343962 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9907190d-ca51-4c7a-8773-56c382d6f8f6 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments/0d801e23-7542-4f59-ac5d-2bfe8846b5b5" status: 202 len: 0 microversion: 2.1 time: 0.166001 Sep 01 15:05:08.344467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 369/740] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:05:08 2022] DELETE /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments/0d801e23-7542-4f59-ac5d-2bfe8846b5b5 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:05:14.453226 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b5699b8f-a531-432a-a5a8-52470f2a29f0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: .version_select at 0x7fab73e87d30>, body: {"keypair": {"name": "tempest-keypair-1898720770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxFKvdjKNAyphg/5USOECOtO7H3xvY93nNq33QXdrAg3Dv/kAUu3mIGrmIAn+nkCyx/FWHBIzjhdH6D9/gNryYtYIpg5KV0MGqGmx3mF0aeeupo4sLQ/DTiwHfJMln/Iw=="}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:14.469043 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-b5699b8f-a531-432a-a5a8-52470f2a29f0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for project 0b789cb75bc24a898888246a7745537e. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:05:14.472829 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-b5699b8f-a531-432a-a5a8-52470f2a29f0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for user 27653498cd0a4e089f1cbc43470182ee and project 0b789cb75bc24a898888246a7745537e. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:05:14.494471 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b5699b8f-a531-432a-a5a8-52470f2a29f0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044964 Sep 01 15:05:14.494988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 372/741] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 1 15:05:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:15.745085 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1635010731", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf8cd5c2-fc41-47d1-b1ef-d6d4b64d51b6"}], "security_groups": [{"name": "tempest-securitygroup--1101578600"}], "key_name": "tempest-keypair-1898720770", "user_data": "}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:15.753541 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=20 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:15.850897 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.network.neutron [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] validate_networks() for [('bf8cd5c2-fc41-47d1-b1ef-d6d4b64d51b6', None, None, None, None, None)] {{(pid=120554) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:05:15.861301 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7bebac1a-f2ef-4b5a-98df-8baa88a1dcfd tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:15.863441 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7bebac1a-f2ef-4b5a-98df-8baa88a1dcfd tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:15.870133 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7bebac1a-f2ef-4b5a-98df-8baa88a1dcfd tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:15.870654 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7bebac1a-f2ef-4b5a-98df-8baa88a1dcfd tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:15.871147 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7bebac1a-f2ef-4b5a-98df-8baa88a1dcfd tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:15.871843 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7bebac1a-f2ef-4b5a-98df-8baa88a1dcfd tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:15.872297 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7bebac1a-f2ef-4b5a-98df-8baa88a1dcfd tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:15.872915 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7bebac1a-f2ef-4b5a-98df-8baa88a1dcfd tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:15.875436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:15.904161 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7bebac1a-f2ef-4b5a-98df-8baa88a1dcfd tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047184 Sep 01 15:05:15.904719 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 373/742] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:05:15 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 15:05:16.022260 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cf6b7906-cb8a-4613-a11a-aa6e77bc8cb5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:16.024442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-cf6b7906-cb8a-4613-a11a-aa6e77bc8cb5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:16.031242 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf6b7906-cb8a-4613-a11a-aa6e77bc8cb5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:16.031845 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf6b7906-cb8a-4613-a11a-aa6e77bc8cb5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:16.032352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf6b7906-cb8a-4613-a11a-aa6e77bc8cb5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:16.033120 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf6b7906-cb8a-4613-a11a-aa6e77bc8cb5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:16.033654 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf6b7906-cb8a-4613-a11a-aa6e77bc8cb5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:16.034178 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf6b7906-cb8a-4613-a11a-aa6e77bc8cb5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:16.065488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cf6b7906-cb8a-4613-a11a-aa6e77bc8cb5 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047163 Sep 01 15:05:16.066043 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 374/743] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:05:16 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 15:05:16.126509 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1b09131c-ad33-409f-8b89-a369b73ac2ef tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:16.127009 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1b09131c-ad33-409f-8b89-a369b73ac2ef tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:16.132895 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b09131c-ad33-409f-8b89-a369b73ac2ef tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:16.133391 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b09131c-ad33-409f-8b89-a369b73ac2ef tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:16.133829 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b09131c-ad33-409f-8b89-a369b73ac2ef tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:16.134541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b09131c-ad33-409f-8b89-a369b73ac2ef tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:16.135012 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b09131c-ad33-409f-8b89-a369b73ac2ef tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:16.135439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1b09131c-ad33-409f-8b89-a369b73ac2ef tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:16.161557 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1b09131c-ad33-409f-8b89-a369b73ac2ef tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Going to try to terminate instance {{(pid=120553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:05:16.224269 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Flavor limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:05:16.224825 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Image limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:05:16.225505 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Flavor pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:05:16.225910 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Image pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:05:16.226495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:05:16.238008 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1b09131c-ad33-409f-8b89-a369b73ac2ef tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 204 len: 0 microversion: 2.1 time: 0.114919 Sep 01 15:05:16.238285 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:16.238904 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 375/744] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:05:16 2022] DELETE /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 15:05:16.239116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:16.239620 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:16.240350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:16.240808 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:16.241233 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:16.247523 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-446972d6-4c13-491c-ac44-35b3e8fa5f93 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:16.248252 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-446972d6-4c13-491c-ac44-35b3e8fa5f93 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:16.251834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:16.254215 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-446972d6-4c13-491c-ac44-35b3e8fa5f93 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:16.254741 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-446972d6-4c13-491c-ac44-35b3e8fa5f93 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:16.255184 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-446972d6-4c13-491c-ac44-35b3e8fa5f93 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:16.255907 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-446972d6-4c13-491c-ac44-35b3e8fa5f93 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:16.256346 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-446972d6-4c13-491c-ac44-35b3e8fa5f93 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:16.256783 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-446972d6-4c13-491c-ac44-35b3e8fa5f93 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:16.265396 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for project 0b789cb75bc24a898888246a7745537e. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:05:16.269303 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for user 27653498cd0a4e089f1cbc43470182ee and project 0b789cb75bc24a898888246a7745537e. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:05:16.281467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Going to run 1 instances... {{(pid=120554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:05:16.283943 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:05:16.335124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-8bfde384-948a-4d35-9694-cb2d62f9f2f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.595147 Sep 01 15:05:16.335953 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 370/745] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:05:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:05:16.346970 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-baaaf0de-f7cf-49cc-a2d7-367cd7dc3277 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:16.347592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-baaaf0de-f7cf-49cc-a2d7-367cd7dc3277 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:16.396310 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-446972d6-4c13-491c-ac44-35b3e8fa5f93 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:16.403202 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-baaaf0de-f7cf-49cc-a2d7-367cd7dc3277 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:16.404852 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-446972d6-4c13-491c-ac44-35b3e8fa5f93 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1672 microversion: 2.1 time: 0.161568 Sep 01 15:05:16.405423 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 376/746] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:16 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:05:16.413562 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-baaaf0de-f7cf-49cc-a2d7-367cd7dc3277 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1242 microversion: 2.1 time: 0.070410 Sep 01 15:05:16.424137 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 371/747] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:16 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:05:17.427562 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-71e3f545-c6bf-4afa-a758-3671a05e14ed tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:17.428214 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-71e3f545-c6bf-4afa-a758-3671a05e14ed tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:17.434187 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9f6cec0a-e629-4523-9d2d-820ae7a016cf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:17.434750 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-71e3f545-c6bf-4afa-a758-3671a05e14ed tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:17.434859 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9f6cec0a-e629-4523-9d2d-820ae7a016cf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:17.435251 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-71e3f545-c6bf-4afa-a758-3671a05e14ed tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:17.435733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-71e3f545-c6bf-4afa-a758-3671a05e14ed tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:17.436433 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-71e3f545-c6bf-4afa-a758-3671a05e14ed tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:17.436896 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-71e3f545-c6bf-4afa-a758-3671a05e14ed tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:17.437328 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-71e3f545-c6bf-4afa-a758-3671a05e14ed tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:17.441440 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9f6cec0a-e629-4523-9d2d-820ae7a016cf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:17.441907 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9f6cec0a-e629-4523-9d2d-820ae7a016cf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:17.442381 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9f6cec0a-e629-4523-9d2d-820ae7a016cf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:17.443078 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9f6cec0a-e629-4523-9d2d-820ae7a016cf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:17.443536 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9f6cec0a-e629-4523-9d2d-820ae7a016cf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:17.443967 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9f6cec0a-e629-4523-9d2d-820ae7a016cf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:17.503588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9f6cec0a-e629-4523-9d2d-820ae7a016cf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:17.511314 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9f6cec0a-e629-4523-9d2d-820ae7a016cf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1246 microversion: 2.1 time: 0.080885 Sep 01 15:05:17.511928 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 372/748] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:17 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:05:17.567462 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-71e3f545-c6bf-4afa-a758-3671a05e14ed tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:17.575743 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-71e3f545-c6bf-4afa-a758-3671a05e14ed tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1672 microversion: 2.1 time: 0.152087 Sep 01 15:05:17.576302 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 377/749] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:17 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:18.532160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f056a37b-350f-46f6-8068-acf50fa48ecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:18.532785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f056a37b-350f-46f6-8068-acf50fa48ecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:18.540172 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f056a37b-350f-46f6-8068-acf50fa48ecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:18.540781 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f056a37b-350f-46f6-8068-acf50fa48ecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:18.541291 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f056a37b-350f-46f6-8068-acf50fa48ecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:18.542262 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f056a37b-350f-46f6-8068-acf50fa48ecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:18.543485 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f056a37b-350f-46f6-8068-acf50fa48ecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:18.543954 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f056a37b-350f-46f6-8068-acf50fa48ecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:18.603177 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-49aac762-1682-4e70-8397-e415376fca9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:18.604517 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-49aac762-1682-4e70-8397-e415376fca9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:18.610453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:18.617275 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49aac762-1682-4e70-8397-e415376fca9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:18.618087 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49aac762-1682-4e70-8397-e415376fca9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:18.625316 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f056a37b-350f-46f6-8068-acf50fa48ecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:18.629565 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49aac762-1682-4e70-8397-e415376fca9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:18.630366 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49aac762-1682-4e70-8397-e415376fca9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:18.630845 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49aac762-1682-4e70-8397-e415376fca9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:18.631273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-49aac762-1682-4e70-8397-e415376fca9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:18.647841 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f056a37b-350f-46f6-8068-acf50fa48ecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1302 microversion: 2.1 time: 0.119392 Sep 01 15:05:18.648433 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 373/750] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:18 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1302 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:18.754855 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-49aac762-1682-4e70-8397-e415376fca9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82255a5060674d77a554e34f89ab1bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0202aa985634c8b8b241ce016600b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:18.764724 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-49aac762-1682-4e70-8397-e415376fca9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 200 len: 1604 microversion: 2.1 time: 0.171770 Sep 01 15:05:18.766107 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 378/751] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:18 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 1604 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:18.936781 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-6940e914-f920-43d0-bdb5-6a7def58896b req-ae339aa5-4c37-4aff-8c15-6a9d54d86b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db8d4b2-4b38-48ae-addc-67c7e40eabc0", "name": "network-vif-deleted", "tag": "89f425d3-f815-4c25-ac37-19f69ecd156b"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:18.947486 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-6940e914-f920-43d0-bdb5-6a7def58896b req-ae339aa5-4c37-4aff-8c15-6a9d54d86b73 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:18.948396 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-6940e914-f920-43d0-bdb5-6a7def58896b req-ae339aa5-4c37-4aff-8c15-6a9d54d86b73 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:18.949075 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-6940e914-f920-43d0-bdb5-6a7def58896b req-ae339aa5-4c37-4aff-8c15-6a9d54d86b73 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:18.963116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-6940e914-f920-43d0-bdb5-6a7def58896b req-ae339aa5-4c37-4aff-8c15-6a9d54d86b73 service nova] Creating event network-vif-deleted:89f425d3-f815-4c25-ac37-19f69ecd156b for instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 on hv-cinder-85505 Sep 01 15:05:18.970178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-6940e914-f920-43d0-bdb5-6a7def58896b req-ae339aa5-4c37-4aff-8c15-6a9d54d86b73 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037441 Sep 01 15:05:18.978168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 374/752] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:05:19.671238 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1eb9a7fd-256e-4159-9bc8-19aabaa21b5e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:19.671858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1eb9a7fd-256e-4159-9bc8-19aabaa21b5e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:19.678775 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1eb9a7fd-256e-4159-9bc8-19aabaa21b5e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:19.679527 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1eb9a7fd-256e-4159-9bc8-19aabaa21b5e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:19.679973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1eb9a7fd-256e-4159-9bc8-19aabaa21b5e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:19.680681 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1eb9a7fd-256e-4159-9bc8-19aabaa21b5e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:19.681313 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1eb9a7fd-256e-4159-9bc8-19aabaa21b5e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:19.681742 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1eb9a7fd-256e-4159-9bc8-19aabaa21b5e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:19.792586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:19.794510 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:19.801913 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:19.803024 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:19.809985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:19.810845 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:19.811333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:19.813187 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:19.831471 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] HTTP exception thrown: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Request method failure captured: Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 HTTP/1.1 Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMiel5woVhCnfYfYdC-lPyAQHEGpTEdy6obyvRSwaokAoLL7uS0JtJbR6KL-8CpDcoub5f5n5peFJgNDfdt6QAjQyf6e7O9zNvwbqCiOtFwo5zZz7KYN_drxeFwiJuhPGn6fQvwxO1_vXzI0jY8_nDFkAP6AKFh5zf2OWSOwv2slWS8 Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:05:19.833116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0202aa985634c8b8b241ce016600b19", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 82255a5060674d77a554e34f89ab1bff Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:19.834765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '2db8d4b2-4b38-48ae-addc-67c7e40eabc0'} Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:19.835698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:19.837157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:19.840550 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Returning 404 to user: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:19.841606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0714895e-5389-4b43-8679-10b9e7a125e8 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 404 len: 111 microversion: 2.1 time: 0.057147 Sep 01 15:05:19.845786 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 375/753] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:19 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 15:05:19.850537 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3d81c31d-5d4f-469a-a28f-5267da05ee9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '.version_select at 0x7fab73cc8550>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:19.861571 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1eb9a7fd-256e-4159-9bc8-19aabaa21b5e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:19.869819 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1eb9a7fd-256e-4159-9bc8-19aabaa21b5e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1368 microversion: 2.1 time: 0.203303 Sep 01 15:05:19.871816 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 379/754] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:19 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:19.889207 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3d81c31d-5d4f-469a-a28f-5267da05ee9f tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475780712" status: 202 len: 0 microversion: 2.1 time: 0.042256 Sep 01 15:05:19.889863 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 376/755] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Sep 1 15:05:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475780712 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:05:20.231048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-9fe2d343-0b01-4b8c-99d4-00a3cdbde17a req-a522f069-9146-4ca0-b19a-c8faf09bf02e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "352d9545-b008-461c-b5ed-c95887f86e98", "tag": "25d84137-f847-437d-b4ba-c5af2d246e8a"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:20.242917 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-9fe2d343-0b01-4b8c-99d4-00a3cdbde17a req-a522f069-9146-4ca0-b19a-c8faf09bf02e service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:20.243797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-9fe2d343-0b01-4b8c-99d4-00a3cdbde17a req-a522f069-9146-4ca0-b19a-c8faf09bf02e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:20.244587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-9fe2d343-0b01-4b8c-99d4-00a3cdbde17a req-a522f069-9146-4ca0-b19a-c8faf09bf02e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:20.258271 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-9fe2d343-0b01-4b8c-99d4-00a3cdbde17a req-a522f069-9146-4ca0-b19a-c8faf09bf02e service nova] Creating event network-changed:25d84137-f847-437d-b4ba-c5af2d246e8a for instance 352d9545-b008-461c-b5ed-c95887f86e98 on hv-cinder-85505 Sep 01 15:05:20.264502 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-9fe2d343-0b01-4b8c-99d4-00a3cdbde17a req-a522f069-9146-4ca0-b19a-c8faf09bf02e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037311 Sep 01 15:05:20.265281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 380/756] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:20.892570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-76130dcb-818b-4d73-9d66-de0e9ad40f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:20.893156 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-76130dcb-818b-4d73-9d66-de0e9ad40f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:20.899981 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-76130dcb-818b-4d73-9d66-de0e9ad40f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:20.900503 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-76130dcb-818b-4d73-9d66-de0e9ad40f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:20.900974 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-76130dcb-818b-4d73-9d66-de0e9ad40f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:20.901657 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-76130dcb-818b-4d73-9d66-de0e9ad40f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:20.902112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-76130dcb-818b-4d73-9d66-de0e9ad40f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:20.903054 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-76130dcb-818b-4d73-9d66-de0e9ad40f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:21.030825 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-76130dcb-818b-4d73-9d66-de0e9ad40f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:21.038424 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-76130dcb-818b-4d73-9d66-de0e9ad40f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1368 microversion: 2.1 time: 0.150391 Sep 01 15:05:21.038975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 377/757] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:20 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:22.061629 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2b6f3c06-7166-4775-9a0f-304ab4ec72c3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:22.062389 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2b6f3c06-7166-4775-9a0f-304ab4ec72c3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:22.068637 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b6f3c06-7166-4775-9a0f-304ab4ec72c3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:22.069072 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b6f3c06-7166-4775-9a0f-304ab4ec72c3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:22.069512 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b6f3c06-7166-4775-9a0f-304ab4ec72c3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:22.070203 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b6f3c06-7166-4775-9a0f-304ab4ec72c3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:22.070686 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b6f3c06-7166-4775-9a0f-304ab4ec72c3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:22.071116 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2b6f3c06-7166-4775-9a0f-304ab4ec72c3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:22.199967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2b6f3c06-7166-4775-9a0f-304ab4ec72c3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:22.207028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2b6f3c06-7166-4775-9a0f-304ab4ec72c3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1368 microversion: 2.1 time: 0.150899 Sep 01 15:05:22.207584 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 381/758] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:22 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:22.865208 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:22.865686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:22.872817 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:22.873336 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:22.873777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:22.874505 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:22.874963 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:22.875545 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:22.889576 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] HTTP exception thrown: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Request method failure captured: Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: DELETE /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 HTTP/1.1 Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMiel5woVhCnfYfYdC-lPyAQHEGpTEdy6obyvRSwaokAoLL7uS0JtJbR6KL-8CpDcoub5f5n5peFJgNDfdt6QAjQyf6e7O9zNvwbqCiOtFwo5zZz7KYN_drxeFwiJuhPGn6fQvwxO1_vXzI0jY8_nDFkAP6AKFh5zf2OWSOwv2slWS8 Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:05:22.891171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0202aa985634c8b8b241ce016600b19", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 82255a5060674d77a554e34f89ab1bff Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:22.892780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '2db8d4b2-4b38-48ae-addc-67c7e40eabc0'} Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:22.893567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:22.894886 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:22.896129 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Returning 404 to user: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:22.896129 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-eb550b7f-a432-4d9c-a93b-25943423e496 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 404 len: 111 microversion: 2.1 time: 0.031393 Sep 01 15:05:22.896129 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 378/759] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:05:22 2022] DELETE /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:05:22.901477 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:22.902851 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2db8d4b2-4b38-48ae-addc-67c7e40eabc0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:22.908765 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:22.909261 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:22.909710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:22.910440 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:22.910909 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:22.911344 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:22.924967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] HTTP exception thrown: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Request method failure captured: Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 HTTP/1.1 Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMiel5woVhCnfYfYdC-lPyAQHEGpTEdy6obyvRSwaokAoLL7uS0JtJbR6KL-8CpDcoub5f5n5peFJgNDfdt6QAjQyf6e7O9zNvwbqCiOtFwo5zZz7KYN_drxeFwiJuhPGn6fQvwxO1_vXzI0jY8_nDFkAP6AKFh5zf2OWSOwv2slWS8 Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:05:22.926568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0202aa985634c8b8b241ce016600b19", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 82255a5060674d77a554e34f89ab1bff Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:22.929101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '2db8d4b2-4b38-48ae-addc-67c7e40eabc0'} Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:22.930689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. Sep 01 15:05:22.932414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:22.933698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Returning 404 to user: Instance 2db8d4b2-4b38-48ae-addc-67c7e40eabc0 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:22.933698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-bb5d240f-7b7f-4c48-95fd-06f9e936a15b tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0" status: 404 len: 111 microversion: 2.1 time: 0.030381 Sep 01 15:05:22.933698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 382/760] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:22 2022] GET /compute/v2.1/servers/2db8d4b2-4b38-48ae-addc-67c7e40eabc0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:05:23.227037 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ec0cb398-f5d4-4242-8f3d-dcb5fe435899 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:23.227666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ec0cb398-f5d4-4242-8f3d-dcb5fe435899 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:23.233592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ec0cb398-f5d4-4242-8f3d-dcb5fe435899 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:23.234087 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ec0cb398-f5d4-4242-8f3d-dcb5fe435899 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:23.234574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ec0cb398-f5d4-4242-8f3d-dcb5fe435899 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:23.235273 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ec0cb398-f5d4-4242-8f3d-dcb5fe435899 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:23.235739 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ec0cb398-f5d4-4242-8f3d-dcb5fe435899 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:23.236186 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ec0cb398-f5d4-4242-8f3d-dcb5fe435899 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:23.368557 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ec0cb398-f5d4-4242-8f3d-dcb5fe435899 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:23.376928 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ec0cb398-f5d4-4242-8f3d-dcb5fe435899 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1368 microversion: 2.1 time: 0.153711 Sep 01 15:05:23.377487 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 379/761] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:23 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:23.473338 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-743fff29-1899-4800-9af6-c54c10133b7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:23.475550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-743fff29-1899-4800-9af6-c54c10133b7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:23.482408 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-743fff29-1899-4800-9af6-c54c10133b7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:23.482891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-743fff29-1899-4800-9af6-c54c10133b7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:23.483328 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-743fff29-1899-4800-9af6-c54c10133b7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:23.484019 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-743fff29-1899-4800-9af6-c54c10133b7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:23.484474 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-743fff29-1899-4800-9af6-c54c10133b7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:23.484899 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-743fff29-1899-4800-9af6-c54c10133b7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:23.514541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-743fff29-1899-4800-9af6-c54c10133b7b tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045118 Sep 01 15:05:23.515073 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 383/762] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 1 15:05:23 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:23.577451 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4170dc53-4bbc-4eac-9339-e6fbfe490fd7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:23.577943 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4170dc53-4bbc-4eac-9339-e6fbfe490fd7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:23.583853 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4170dc53-4bbc-4eac-9339-e6fbfe490fd7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:23.584339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4170dc53-4bbc-4eac-9339-e6fbfe490fd7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:23.584783 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4170dc53-4bbc-4eac-9339-e6fbfe490fd7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:23.585476 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4170dc53-4bbc-4eac-9339-e6fbfe490fd7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:23.585935 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4170dc53-4bbc-4eac-9339-e6fbfe490fd7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:23.586391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4170dc53-4bbc-4eac-9339-e6fbfe490fd7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:23.612584 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4170dc53-4bbc-4eac-9339-e6fbfe490fd7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:05:23.838402 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4170dc53-4bbc-4eac-9339-e6fbfe490fd7 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 204 len: 0 microversion: 2.20 time: 0.264909 Sep 01 15:05:23.839308 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 380/763] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Sep 1 15:05:23 2022] DELETE /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 15:05:23.848147 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:23.848805 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:23.854810 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:23.855382 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:23.855824 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:23.856604 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:23.857052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:23.857477 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:23.990931 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:23.999534 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:24.001037 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:24.002199 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a92f31f6-4a5a-4f46-b6a3-c9e0b1197a1c tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.158149 Sep 01 15:05:24.002813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 384/764] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:05:23 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:05:24.071189 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:24.071770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:24.078868 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:24.079350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:24.079784 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:24.080467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:24.080922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:24.081345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:24.094569 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] HTTP exception thrown: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Request method failure captured: Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: DELETE /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 HTTP/1.1 Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMiel5woVhCnfYfYdC-lPyAQHEGpTEdy6obyvRSwaokAoLL7uS0JtJbR6KL-8CpDcoub5f5n5peFJgNDfdt6QAjQyf6e7O9zNvwbqCiOtFwo5zZz7KYN_drxeFwiJuhPGn6fQvwxO1_vXzI0jY8_nDFkAP6AKFh5zf2OWSOwv2slWS8 Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:05:24.096222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0202aa985634c8b8b241ce016600b19", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 82255a5060674d77a554e34f89ab1bff Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:05:24.097588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '2c1140cc-9fea-4464-8b9b-80db1ba7afd0'} Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:24.098345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:05:24.099852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:24.101495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Returning 404 to user: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:24.101495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e2ad9805-94fa-442c-bc97-9423617b6038 tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 404 len: 111 microversion: 2.1 time: 0.030599 Sep 01 15:05:24.101495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 381/765] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:05:24 2022] DELETE /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:05:24.106672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:24.107289 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] [instance: 2c1140cc-9fea-4464-8b9b-80db1ba7afd0] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:24.113218 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:24.113702 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:24.114140 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:24.114867 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:24.115325 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:24.115749 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:24.130847 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] HTTP exception thrown: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Request method failure captured: Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 HTTP/1.1 Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMiel5woVhCnfYfYdC-lPyAQHEGpTEdy6obyvRSwaokAoLL7uS0JtJbR6KL-8CpDcoub5f5n5peFJgNDfdt6QAjQyf6e7O9zNvwbqCiOtFwo5zZz7KYN_drxeFwiJuhPGn6fQvwxO1_vXzI0jY8_nDFkAP6AKFh5zf2OWSOwv2slWS8 Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:05:24.132337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b0202aa985634c8b8b241ce016600b19", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b0202aa985634c8b8b241ce016600b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: b0202aa985634c8b8b241ce016600b19 Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1293450046 Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 82255a5060674d77a554e34f89ab1bff Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeTestJSON-1293450046-project Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:05:24.133945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '2c1140cc-9fea-4464-8b9b-80db1ba7afd0'} Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:24.134860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. Sep 01 15:05:24.136348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:24.138199 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] Returning 404 to user: Instance 2c1140cc-9fea-4464-8b9b-80db1ba7afd0 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:24.138199 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9a20f7c6-1d3a-4704-8bc1-63c6d373a46e tempest-AttachVolumeTestJSON-1293450046 tempest-AttachVolumeTestJSON-1293450046-project] 10.222.0.33 "GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0" status: 404 len: 111 microversion: 2.1 time: 0.030837 Sep 01 15:05:24.138199 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 385/766] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:24 2022] GET /compute/v2.1/servers/2c1140cc-9fea-4464-8b9b-80db1ba7afd0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:05:24.398087 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0f470edd-148d-4e16-84bd-f0cec652101b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:24.398758 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0f470edd-148d-4e16-84bd-f0cec652101b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:24.404673 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0f470edd-148d-4e16-84bd-f0cec652101b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:24.405163 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0f470edd-148d-4e16-84bd-f0cec652101b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:24.405602 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0f470edd-148d-4e16-84bd-f0cec652101b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:24.406318 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0f470edd-148d-4e16-84bd-f0cec652101b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:24.406775 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0f470edd-148d-4e16-84bd-f0cec652101b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:24.407200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0f470edd-148d-4e16-84bd-f0cec652101b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:24.538125 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0f470edd-148d-4e16-84bd-f0cec652101b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:24.546545 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0f470edd-148d-4e16-84bd-f0cec652101b tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1368 microversion: 2.1 time: 0.151976 Sep 01 15:05:24.547093 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 382/767] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:24 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:25.027183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:25.027927 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:25.030412 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=4 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:25.036174 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:25.036712 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:25.037153 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:25.037853 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:25.038339 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:25.038768 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:25.500247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:25.510114 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:25.512477 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:25.518402 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-893b0b88-5e92-4d49-a78f-2c9c1ca45a28 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1723 microversion: 2.20 time: 0.491434 Sep 01 15:05:25.535530 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 386/768] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:05:25 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1723 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:05:25.568121 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9a960b57-e6e8-4df0-9b94-6787025eecf6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:25.569609 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9a960b57-e6e8-4df0-9b94-6787025eecf6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:25.576766 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a960b57-e6e8-4df0-9b94-6787025eecf6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:25.577572 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a960b57-e6e8-4df0-9b94-6787025eecf6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:25.578173 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a960b57-e6e8-4df0-9b94-6787025eecf6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:25.579382 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a960b57-e6e8-4df0-9b94-6787025eecf6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:25.580016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a960b57-e6e8-4df0-9b94-6787025eecf6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:25.580628 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a960b57-e6e8-4df0-9b94-6787025eecf6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:25.910125 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-674b5aad-540c-481b-ad59-c5a8fe44d807 req-0bf652e5-ce53-45df-98f1-000d2dfb6020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "352d9545-b008-461c-b5ed-c95887f86e98", "name": "network-vif-plugged", "status": "completed", "tag": "25d84137-f847-437d-b4ba-c5af2d246e8a"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:25.924716 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-674b5aad-540c-481b-ad59-c5a8fe44d807 req-0bf652e5-ce53-45df-98f1-000d2dfb6020 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:25.925342 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-674b5aad-540c-481b-ad59-c5a8fe44d807 req-0bf652e5-ce53-45df-98f1-000d2dfb6020 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:25.925846 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-674b5aad-540c-481b-ad59-c5a8fe44d807 req-0bf652e5-ce53-45df-98f1-000d2dfb6020 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:25.938183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-674b5aad-540c-481b-ad59-c5a8fe44d807 req-0bf652e5-ce53-45df-98f1-000d2dfb6020 service nova] Creating event network-vif-plugged:25d84137-f847-437d-b4ba-c5af2d246e8a for instance 352d9545-b008-461c-b5ed-c95887f86e98 on hv-cinder-85505 Sep 01 15:05:25.944449 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-674b5aad-540c-481b-ad59-c5a8fe44d807 req-0bf652e5-ce53-45df-98f1-000d2dfb6020 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037867 Sep 01 15:05:25.945501 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 387/769] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:05:25.986257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9a960b57-e6e8-4df0-9b94-6787025eecf6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:26.000130 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9a960b57-e6e8-4df0-9b94-6787025eecf6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1368 microversion: 2.1 time: 0.435724 Sep 01 15:05:26.016313 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 383/770] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:25 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1368 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:05:26.544689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:26.551579 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:26.572066 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:26.572311 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-56318087-2354-4b04-a90c-35b4dd61defa req-d2a29baf-8da4-4ec6-925f-a6a42daab2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ea0e09a-fcb0-4aab-844d-c9b7d170ec95", "name": "network-vif-deleted", "tag": "2c6c7ac6-7b01-495d-911b-2cf5b78b8904"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:26.573442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:26.574669 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:26.575067 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:26.578043 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:26.578743 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:26.589989 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:26.593547 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=8 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:26.608247 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-56318087-2354-4b04-a90c-35b4dd61defa req-d2a29baf-8da4-4ec6-925f-a6a42daab2ae service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:26.609010 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-56318087-2354-4b04-a90c-35b4dd61defa req-d2a29baf-8da4-4ec6-925f-a6a42daab2ae service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:26.610413 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-56318087-2354-4b04-a90c-35b4dd61defa req-d2a29baf-8da4-4ec6-925f-a6a42daab2ae service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:26.625246 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-56318087-2354-4b04-a90c-35b4dd61defa req-d2a29baf-8da4-4ec6-925f-a6a42daab2ae service nova] Creating event network-vif-deleted:2c6c7ac6-7b01-495d-911b-2cf5b78b8904 for instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 on hv-cinder-85505 Sep 01 15:05:26.657693 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-56318087-2354-4b04-a90c-35b4dd61defa req-d2a29baf-8da4-4ec6-925f-a6a42daab2ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087984 Sep 01 15:05:26.658921 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 384/771] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:26.713267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:26.726592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:26.728051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '229e076684dd4bbdacda2231b18f0875', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f02a6da81c440f9b61e4f2f90f37048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:26.729255 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-543e4094-5172-4ce6-8428-29636843be50 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 200 len: 1656 microversion: 2.20 time: 0.190223 Sep 01 15:05:26.729807 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 388/772] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:05:26 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 1656 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 15:05:27.031266 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-03c8929e-735c-4c4d-b811-c92ec591552e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:27.032349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-03c8929e-735c-4c4d-b811-c92ec591552e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:27.041978 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03c8929e-735c-4c4d-b811-c92ec591552e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:27.042604 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03c8929e-735c-4c4d-b811-c92ec591552e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:27.043726 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03c8929e-735c-4c4d-b811-c92ec591552e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:27.044747 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03c8929e-735c-4c4d-b811-c92ec591552e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:27.045357 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03c8929e-735c-4c4d-b811-c92ec591552e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:27.046043 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03c8929e-735c-4c4d-b811-c92ec591552e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:27.204894 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-03c8929e-735c-4c4d-b811-c92ec591552e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:27.213502 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-03c8929e-735c-4c4d-b811-c92ec591552e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1368 microversion: 2.1 time: 0.194885 Sep 01 15:05:27.214307 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 385/773] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:27 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:27.752995 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:27.754451 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:27.778450 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:27.779338 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:27.780840 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:27.782414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:27.785926 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:27.786784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:27.813445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] HTTP exception thrown: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Request method failure captured: Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 HTTP/1.1 Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMibvqu-4HZAE2EN8yss8gt18CAhQksvM8oDadnh-qdfDhEOyv8muvtYeV-2Ms19Ibd2VHZiT7UpJ0Xv6FID1lXZAa_kcmrmY_D8i5skxeH6hY0Ioee7k0Bd2l8MqsaxOotdUGUPmFXs0PJgcZLgk00zZ7hyuB2bVTqvmz5znZuD30A Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:05:27.818947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f02a6da81c440f9b61e4f2f90f37048", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 229e076684dd4bbdacda2231b18f0875 Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:27.820796 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '1ea0e09a-fcb0-4aab-844d-c9b7d170ec95'} Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:27.821825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:27.823554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:27.826297 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Returning 404 to user: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:27.827784 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-000f1fcc-24f8-4379-8836-d48498daa459 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 404 len: 111 microversion: 2.20 time: 0.078292 Sep 01 15:05:27.828713 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 389/774] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:05:27 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 15:05:27.836994 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e3f6d08d-b0ca-4e71-b72d-ee1447fd2ba2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '.version_select at 0x7fab7b714dc0>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:27.872986 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e3f6d08d-b0ca-4e71-b72d-ee1447fd2ba2 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-314196941" status: 204 len: 0 microversion: 2.20 time: 0.037252 Sep 01 15:05:27.874483 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 386/775] 10.222.0.33 () {60 vars in 1259 bytes} [Thu Sep 1 15:05:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-314196941 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 15:05:28.237197 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4a544cb1-a973-4188-b78f-dd756b319f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:28.237749 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4a544cb1-a973-4188-b78f-dd756b319f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:28.245018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a544cb1-a973-4188-b78f-dd756b319f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:28.245514 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a544cb1-a973-4188-b78f-dd756b319f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:28.246630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a544cb1-a973-4188-b78f-dd756b319f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:28.247325 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a544cb1-a973-4188-b78f-dd756b319f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:28.247781 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a544cb1-a973-4188-b78f-dd756b319f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:28.248203 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4a544cb1-a973-4188-b78f-dd756b319f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:28.451954 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4a544cb1-a973-4188-b78f-dd756b319f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:28.462500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4a544cb1-a973-4188-b78f-dd756b319f6a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1559 microversion: 2.1 time: 0.229239 Sep 01 15:05:28.463663 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 390/776] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:28 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:05:28.486152 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e9f49dc1-2b60-4400-ae11-2c79aa804e96 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:28.488468 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e9f49dc1-2b60-4400-ae11-2c79aa804e96 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:28.497479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e9f49dc1-2b60-4400-ae11-2c79aa804e96 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:28.497956 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e9f49dc1-2b60-4400-ae11-2c79aa804e96 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:28.498419 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e9f49dc1-2b60-4400-ae11-2c79aa804e96 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:28.499117 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e9f49dc1-2b60-4400-ae11-2c79aa804e96 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:28.499567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e9f49dc1-2b60-4400-ae11-2c79aa804e96 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:28.500186 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e9f49dc1-2b60-4400-ae11-2c79aa804e96 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:28.618771 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e9f49dc1-2b60-4400-ae11-2c79aa804e96 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136599 Sep 01 15:05:28.619382 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 387/777] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 1 15:05:28 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:29.413129 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-3fc5a40e-07d9-4b85-9741-e6165901c85f tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] Action: 'create', calling method: .version_select at 0x7fab73eabca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1975118432", "metadata": {"Type": "work"}}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:29.680148 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-24288b65-731d-49bf-b511-7b7d8c4a2b39 req-403a926d-d490-4a00-a94a-7743d1210a51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "352d9545-b008-461c-b5ed-c95887f86e98", "tag": "25d84137-f847-437d-b4ba-c5af2d246e8a"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:29.691625 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-24288b65-731d-49bf-b511-7b7d8c4a2b39 req-403a926d-d490-4a00-a94a-7743d1210a51 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:29.692088 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-24288b65-731d-49bf-b511-7b7d8c4a2b39 req-403a926d-d490-4a00-a94a-7743d1210a51 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:29.692860 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-24288b65-731d-49bf-b511-7b7d8c4a2b39 req-403a926d-d490-4a00-a94a-7743d1210a51 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:29.708350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-24288b65-731d-49bf-b511-7b7d8c4a2b39 req-403a926d-d490-4a00-a94a-7743d1210a51 service nova] Creating event network-changed:25d84137-f847-437d-b4ba-c5af2d246e8a for instance 352d9545-b008-461c-b5ed-c95887f86e98 on hv-cinder-85505 Sep 01 15:05:29.714672 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-24288b65-731d-49bf-b511-7b7d8c4a2b39 req-403a926d-d490-4a00-a94a-7743d1210a51 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037830 Sep 01 15:05:29.715594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 388/778] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:05:29.721513 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-3fc5a40e-07d9-4b85-9741-e6165901c85f tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.428870 Sep 01 15:05:29.728537 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 391/779] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Sep 1 15:05:29 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 15:05:29.754289 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-554bd324-1e83-4977-9751-e12810303198 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] Calling method '.version_select at 0x7fab73d48310>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:29.815136 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-554bd324-1e83-4977-9751-e12810303198 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb" status: 200 len: 353 microversion: 2.1 time: 0.074127 Sep 01 15:05:29.815770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 389/780] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 15:05:29 2022] GET /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:29.974006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:29.974560 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:29.981520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:29.982023 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:29.982508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:29.983212 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:29.983675 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:29.984589 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:29.999817 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] HTTP exception thrown: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Request method failure captured: Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: DELETE /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 HTTP/1.1 Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMibvqu-4HZAE2EN8yss8gt18CAhQksvM8oDadnh-qdfDhEOyv8muvtYeV-2Ms19Ibd2VHZiT7UpJ0Xv6FID1lXZAa_kcmrmY_D8i5skxeH6hY0Ioee7k0Bd2l8MqsaxOotdUGUPmFXs0PJgcZLgk00zZ7hyuB2bVTqvmz5znZuD30A Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:05:30.001413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f02a6da81c440f9b61e4f2f90f37048", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 229e076684dd4bbdacda2231b18f0875 Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:30.003189 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '1ea0e09a-fcb0-4aab-844d-c9b7d170ec95'} Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:30.007492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:30.009368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:30.011004 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Returning 404 to user: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:30.011004 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-dd520d01-19a1-4aad-b365-54c0c9e1471e tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 404 len: 111 microversion: 2.20 time: 0.035031 Sep 01 15:05:30.011004 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 392/781] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Sep 1 15:05:29 2022] DELETE /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 15:05:30.013178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:30.013366 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:30.021407 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:30.021910 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:30.022407 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:30.023128 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:30.023596 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:30.024095 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:30.040177 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] HTTP exception thrown: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Request method failure captured: Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 HTTP/1.1 Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMibvqu-4HZAE2EN8yss8gt18CAhQksvM8oDadnh-qdfDhEOyv8muvtYeV-2Ms19Ibd2VHZiT7UpJ0Xv6FID1lXZAa_kcmrmY_D8i5skxeH6hY0Ioee7k0Bd2l8MqsaxOotdUGUPmFXs0PJgcZLgk00zZ7hyuB2bVTqvmz5znZuD30A Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:05:30.041870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f02a6da81c440f9b61e4f2f90f37048", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 229e076684dd4bbdacda2231b18f0875 Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:30.043787 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '1ea0e09a-fcb0-4aab-844d-c9b7d170ec95'} Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:30.044674 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. Sep 01 15:05:30.046439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:30.047730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Returning 404 to user: Instance 1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:30.047730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d922b290-d27c-4618-ac07-e4e9e83d8204 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95" status: 404 len: 111 microversion: 2.20 time: 0.035409 Sep 01 15:05:30.047730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 390/782] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:05:30 2022] GET /compute/v2.1/servers/1ea0e09a-fcb0-4aab-844d-c9b7d170ec95 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 15:05:30.828973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-26166390-1448-4d8d-8928-702e3c779f85 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] Calling method '.version_select at 0x7fab73c90820>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:30.878879 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-26166390-1448-4d8d-8928-702e3c779f85 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb" status: 200 len: 354 microversion: 2.1 time: 0.053653 Sep 01 15:05:30.879439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 393/783] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 15:05:30 2022] GET /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:30.891697 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-653832eb-354e-4b54-b8f4-8e3d577af8c4 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] Calling method '.version_select at 0x7fab73d7caf0>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:30.942707 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-653832eb-354e-4b54-b8f4-8e3d577af8c4 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb" status: 200 len: 354 microversion: 2.1 time: 0.054293 Sep 01 15:05:30.943307 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 391/784] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 15:05:30 2022] GET /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:30.963648 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-afc8bf74-76a3-4e0b-9a95-1f9a90063445 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] Calling method '.version_select at 0x7fab73c9bc10>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:31.030309 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-afc8bf74-76a3-4e0b-9a95-1f9a90063445 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb" status: 202 len: 0 microversion: 2.1 time: 0.071951 Sep 01 15:05:31.030830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 394/785] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 1 15:05:30 2022] DELETE /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 15:05:31.039226 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-8f9511af-922f-4afa-a258-ad3bfaf45a21 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] Calling method '.version_select at 0x7fab73cc8310>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:31.087302 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-8f9511af-922f-4afa-a258-ad3bfaf45a21 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb" status: 200 len: 353 microversion: 2.1 time: 0.052125 Sep 01 15:05:31.087863 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 392/786] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 15:05:31 2022] GET /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:05:31.196709 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:31.197216 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:31.204710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:31.205197 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:31.205629 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:31.206348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:31.206876 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:31.207324 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:31.211489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:31.225148 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] HTTP exception thrown: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Request method failure captured: Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: DELETE /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf HTTP/1.1 Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMibvqu-4HZAE2EN8yss8gt18CAhQksvM8oDadnh-qdfDhEOyv8muvtYeV-2Ms19Ibd2VHZiT7UpJ0Xv6FID1lXZAa_kcmrmY_D8i5skxeH6hY0Ioee7k0Bd2l8MqsaxOotdUGUPmFXs0PJgcZLgk00zZ7hyuB2bVTqvmz5znZuD30A Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:05:31.226859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f02a6da81c440f9b61e4f2f90f37048", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 229e076684dd4bbdacda2231b18f0875 Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:05:31.228830 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '2570eed9-40bd-40ef-92d6-63b4e3cc83bf'} Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:31.230018 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:05:31.232273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:31.234744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Returning 404 to user: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:31.234744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-20f014a8-688e-4b28-80c0-a956b1534362 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 404 len: 111 microversion: 2.20 time: 0.035666 Sep 01 15:05:31.234744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 395/787] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Sep 1 15:05:31 2022] DELETE /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 15:05:31.237383 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:31.238000 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] [instance: 2570eed9-40bd-40ef-92d6-63b4e3cc83bf] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:31.244899 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:31.245422 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:31.246112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:31.246858 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:31.247322 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:31.247756 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:31.271824 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] HTTP exception thrown: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Request method failure captured: Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf HTTP/1.1 Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMibvqu-4HZAE2EN8yss8gt18CAhQksvM8oDadnh-qdfDhEOyv8muvtYeV-2Ms19Ibd2VHZiT7UpJ0Xv6FID1lXZAa_kcmrmY_D8i5skxeH6hY0Ioee7k0Bd2l8MqsaxOotdUGUPmFXs0PJgcZLgk00zZ7hyuB2bVTqvmz5znZuD30A Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:05:31.273479 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f02a6da81c440f9b61e4f2f90f37048", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f02a6da81c440f9b61e4f2f90f37048"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 2f02a6da81c440f9b61e4f2f90f37048 Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1916281986 Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 229e076684dd4bbdacda2231b18f0875 Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1916281986-project Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:05:31.275167 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '2570eed9-40bd-40ef-92d6-63b4e3cc83bf'} Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:31.276100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. Sep 01 15:05:31.278333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:05:31.279767 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] Returning 404 to user: Instance 2570eed9-40bd-40ef-92d6-63b4e3cc83bf could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:31.279767 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5281ec7a-e780-407c-a985-14e8c2046f93 tempest-AttachVolumeShelveTestJSON-1916281986 tempest-AttachVolumeShelveTestJSON-1916281986-project] 10.222.0.33 "GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf" status: 404 len: 111 microversion: 2.20 time: 0.041615 Sep 01 15:05:31.279767 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 393/788] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 1 15:05:31 2022] GET /compute/v2.1/servers/2570eed9-40bd-40ef-92d6-63b4e3cc83bf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 15:05:32.101037 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bdacac19-05b4-4fc3-850e-a70478760221 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] Calling method '.version_select at 0x7fab73d61af0>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:32.130199 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-bdacac19-05b4-4fc3-850e-a70478760221 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] HTTP exception thrown: Volume f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb could not be found. Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bdacac19-05b4-4fc3-850e-a70478760221 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] Request method failure captured: Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb HTTP/1.1 Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMo5WPRExYsJ4Ld1gTuJlKz0_9atAzS1SGyL--L8JsCwHF0e2G5vSWjy3gRnKpoVXZw9Cmqrt5wnh2ItLf0cKjleyxamVPtrHk92LQ6Y9z0cOp6DOT9Y5wcNB5IQ3Sxa_eYEQ6tTZLdKJ97LO6LzUoqc7TuKfR6VG7Z_QY2PKIkowXU Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 20daf23edeb447dfab9bf828170bd858 Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-VolumesGetTestJSON-1412079113 Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:05:32.132267 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/20daf23edeb447dfab9bf828170bd858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/20daf23edeb447dfab9bf828170bd858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_20daf23edeb447dfab9bf828170bd858", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/20daf23edeb447dfab9bf828170bd858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-VolumesGetTestJSON-1412079113 Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 20daf23edeb447dfab9bf828170bd858 Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-VolumesGetTestJSON-1412079113 Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-VolumesGetTestJSON-1412079113-project Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: d4522eb2588b4ea68495107f261d3427 Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-VolumesGetTestJSON-1412079113-project Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Volume f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb could not be found. Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': 'f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb'} Sep 01 15:05:32.133884 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb could not be found. (HTTP 404) (Request-ID: req-3d7bd0c0-866b-49ee-be7d-cb0db0f292df) Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:32.135034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 15:05:32.136797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb could not be found. Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 15:05:32.138608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb could not be found. Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb could not be found. Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bdacac19-05b4-4fc3-850e-a70478760221 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] Returning 404 to user: Volume f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-bdacac19-05b4-4fc3-850e-a70478760221 tempest-VolumesGetTestJSON-1412079113 tempest-VolumesGetTestJSON-1412079113-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb" status: 404 len: 109 microversion: 2.1 time: 0.036645 Sep 01 15:05:32.140028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 396/789] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 15:05:32 2022] GET /compute/v2.1/os-volumes/f4fb5b44-c7bc-4d59-8ce8-2dc0615ed6eb => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:05:33.997298 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-8477bd3d-5593-49c6-850f-219f00ced1ea tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:33.997799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-8477bd3d-5593-49c6-850f-219f00ced1ea tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:34.009590 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8477bd3d-5593-49c6-850f-219f00ced1ea tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:34.010546 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8477bd3d-5593-49c6-850f-219f00ced1ea tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:34.011146 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8477bd3d-5593-49c6-850f-219f00ced1ea tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:34.012086 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8477bd3d-5593-49c6-850f-219f00ced1ea tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:34.012756 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8477bd3d-5593-49c6-850f-219f00ced1ea tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:34.013438 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8477bd3d-5593-49c6-850f-219f00ced1ea tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:34.045504 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-8477bd3d-5593-49c6-850f-219f00ced1ea tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:05:34.144090 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-8477bd3d-5593-49c6-850f-219f00ced1ea tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 204 len: 0 microversion: 2.1 time: 0.150167 Sep 01 15:05:34.149995 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 394/790] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:05:33 2022] DELETE /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:05:34.155054 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f6d110f5-73ba-45f3-aeeb-f7c37d6ff458 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:34.156299 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f6d110f5-73ba-45f3-aeeb-f7c37d6ff458 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:34.168385 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6d110f5-73ba-45f3-aeeb-f7c37d6ff458 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:34.171571 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6d110f5-73ba-45f3-aeeb-f7c37d6ff458 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:34.172300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6d110f5-73ba-45f3-aeeb-f7c37d6ff458 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:34.174316 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6d110f5-73ba-45f3-aeeb-f7c37d6ff458 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:34.175631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6d110f5-73ba-45f3-aeeb-f7c37d6ff458 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:34.176146 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f6d110f5-73ba-45f3-aeeb-f7c37d6ff458 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:34.427733 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f6d110f5-73ba-45f3-aeeb-f7c37d6ff458 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:34.435991 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f6d110f5-73ba-45f3-aeeb-f7c37d6ff458 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1577 microversion: 2.1 time: 0.285442 Sep 01 15:05:34.436788 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 397/791] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:34 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1577 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:35.460047 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f637c535-e83a-475e-9442-966596c1348e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:35.460749 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f637c535-e83a-475e-9442-966596c1348e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:35.468410 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f637c535-e83a-475e-9442-966596c1348e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:35.468905 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f637c535-e83a-475e-9442-966596c1348e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:35.469752 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f637c535-e83a-475e-9442-966596c1348e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:35.470839 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f637c535-e83a-475e-9442-966596c1348e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:35.471294 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f637c535-e83a-475e-9442-966596c1348e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:35.471926 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f637c535-e83a-475e-9442-966596c1348e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:35.628033 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f637c535-e83a-475e-9442-966596c1348e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:35.630649 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:35.639575 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f637c535-e83a-475e-9442-966596c1348e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1577 microversion: 2.1 time: 0.183518 Sep 01 15:05:35.654291 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 395/792] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:35 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:36.573269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-fc356f61-9495-4a1f-8b78-b2439f0ba3d4 req-74cd4ad8-805b-4bfd-85c1-37f5b6803380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4561748-1530-48b0-b782-1bceb2ecb240", "name": "network-vif-deleted", "tag": "9df92666-196a-402d-a511-48632bf3326d"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:36.591582 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-fc356f61-9495-4a1f-8b78-b2439f0ba3d4 req-74cd4ad8-805b-4bfd-85c1-37f5b6803380 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:36.592299 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-fc356f61-9495-4a1f-8b78-b2439f0ba3d4 req-74cd4ad8-805b-4bfd-85c1-37f5b6803380 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:36.596544 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-fc356f61-9495-4a1f-8b78-b2439f0ba3d4 req-74cd4ad8-805b-4bfd-85c1-37f5b6803380 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:36.616367 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-fc356f61-9495-4a1f-8b78-b2439f0ba3d4 req-74cd4ad8-805b-4bfd-85c1-37f5b6803380 service nova] Creating event network-vif-deleted:9df92666-196a-402d-a511-48632bf3326d for instance e4561748-1530-48b0-b782-1bceb2ecb240 on hv-cinder-85505 Sep 01 15:05:36.623988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-fc356f61-9495-4a1f-8b78-b2439f0ba3d4 req-74cd4ad8-805b-4bfd-85c1-37f5b6803380 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054235 Sep 01 15:05:36.625288 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 398/793] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:36.662133 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-cc6030bc-f925-4cd5-9901-c8f8f64d9cc7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:36.663022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-cc6030bc-f925-4cd5-9901-c8f8f64d9cc7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:36.684917 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cc6030bc-f925-4cd5-9901-c8f8f64d9cc7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:36.687153 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cc6030bc-f925-4cd5-9901-c8f8f64d9cc7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:36.689847 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cc6030bc-f925-4cd5-9901-c8f8f64d9cc7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:36.692184 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cc6030bc-f925-4cd5-9901-c8f8f64d9cc7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:36.694259 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cc6030bc-f925-4cd5-9901-c8f8f64d9cc7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:36.694954 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-cc6030bc-f925-4cd5-9901-c8f8f64d9cc7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:36.819457 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-cc6030bc-f925-4cd5-9901-c8f8f64d9cc7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:36.839791 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-cc6030bc-f925-4cd5-9901-c8f8f64d9cc7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 200 len: 1224 microversion: 2.1 time: 0.182640 Sep 01 15:05:36.841339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 396/794] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:36 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 1224 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:37.861236 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:37.861945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:37.870854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:37.872231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:37.872696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:37.873451 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:37.873943 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:37.874392 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:37.895526 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2264219f-7d7d-4924-bb86-bfb3d5ca0f53 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] Calling method '.version_select at 0x7fab7b7143a0>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:37.901541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] HTTP exception thrown: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Request method failure captured: Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 HTTP/1.1 Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMmM5arFh5_6MDEdv1X28eUF86VGRpd75Ifpn2OamslpHrHxi4vmRcBA83KmQJ7E-QGnspEfEbyeVLHxAlC8q-L77SYqkB3G56JV2eZ3N59_uzufLmUFVkXlzTomnnxFjNxKu5PM6ILUDztvIp7aT18FhA2APucWwZKSOocq3Q78lWw Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 3e49151735934f21a2ea909842e36a05 Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:05:37.904006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3e49151735934f21a2ea909842e36a05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e49151735934f21a2ea909842e36a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3e49151735934f21a2ea909842e36a05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e49151735934f21a2ea909842e36a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 3e49151735934f21a2ea909842e36a05 Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-TestVolumeBootPattern-1713390008-project Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: afa6212f31034e27a8d32f114937190e Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-TestVolumeBootPattern-1713390008-project Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:05:37.905636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': 'e4561748-1530-48b0-b782-1bceb2ecb240'} Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:05:37.906744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:05:37.908231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:05:37.909624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Returning 404 to user: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:05:37.909624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-37fcdbd0-5d63-4010-adc0-8f9f6ff6843b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 404 len: 111 microversion: 2.1 time: 0.048986 Sep 01 15:05:37.909624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 399/795] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:37 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:05:37.975412 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2264219f-7d7d-4924-bb86-bfb3d5ca0f53 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/1e03795b-437c-4504-a106-d63069913866" status: 200 len: 350 microversion: 2.1 time: 0.083608 Sep 01 15:05:37.975988 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 397/796] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 15:05:37 2022] GET /compute/v2.1/os-volumes/1e03795b-437c-4504-a106-d63069913866 => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:05:38.023420 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-192508900", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-971708312", "security_groups": [{"name": "tempest-secgroup-smoke-247398210"}], "block_device_mapping_v2": [{"uuid": "8e89ba33-63ee-47c1-8689-87b2cd01f6d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "056da220-38ab-4965-aff0-511e66373f02"}]}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:38.148407 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.network.neutron [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] validate_networks() for [('056da220-38ab-4965-aff0-511e66373f02', None, None, None, None, None)] {{(pid=120553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:05:38.623478 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Flavor limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:05:38.623901 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Image limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:05:38.624377 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Flavor pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:05:38.624917 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Image pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:05:38.625337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:05:38.634642 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:38.635433 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:38.636441 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:38.637281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:38.637965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:38.638587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:38.658087 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Getting quotas for project 3e49151735934f21a2ea909842e36a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:05:38.665765 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Getting quotas for user afa6212f31034e27a8d32f114937190e and project 3e49151735934f21a2ea909842e36a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:05:38.725614 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Going to run 1 instances... {{(pid=120553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:05:38.727832 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e89ba33-63ee-47c1-8689-87b2cd01f6d8',volume_size=None,volume_type=None)] {{(pid=120553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:05:38.866425 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-30c633e3-d3ad-4a6f-aecf-59c51eaf6598 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.847049 Sep 01 15:05:38.867722 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 400/797] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:05:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:05:38.878585 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-feb3844f-4ec4-4941-990a-a32fe2999a1e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:38.879672 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-feb3844f-4ec4-4941-990a-a32fe2999a1e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:38.942842 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-feb3844f-4ec4-4941-990a-a32fe2999a1e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:38.979020 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-feb3844f-4ec4-4941-990a-a32fe2999a1e tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1093 microversion: 2.1 time: 0.104130 Sep 01 15:05:38.979869 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 398/798] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:38 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1093 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:05:39.425847 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2535e440-e883-4770-932e-a3a5fb9133f4 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] Calling method '.version_select at 0x7fab73cbd5e0>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:39.478386 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2535e440-e883-4770-932e-a3a5fb9133f4 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/1b8db1d8-f029-42a4-aa95-4eeb392f4669" status: 200 len: 351 microversion: 2.1 time: 0.056072 Sep 01 15:05:39.478959 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 401/799] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 15:05:39 2022] GET /compute/v2.1/os-volumes/1b8db1d8-f029-42a4-aa95-4eeb392f4669 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:40.001183 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a894ea66-7d47-42f3-b867-fa6a76bcae0c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:40.001825 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a894ea66-7d47-42f3-b867-fa6a76bcae0c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:40.009016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a894ea66-7d47-42f3-b867-fa6a76bcae0c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:40.009883 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a894ea66-7d47-42f3-b867-fa6a76bcae0c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:40.010481 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a894ea66-7d47-42f3-b867-fa6a76bcae0c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:40.011457 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a894ea66-7d47-42f3-b867-fa6a76bcae0c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:40.012145 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a894ea66-7d47-42f3-b867-fa6a76bcae0c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:40.012820 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a894ea66-7d47-42f3-b867-fa6a76bcae0c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:40.105807 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a894ea66-7d47-42f3-b867-fa6a76bcae0c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:40.116402 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a894ea66-7d47-42f3-b867-fa6a76bcae0c tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1209 microversion: 2.1 time: 0.118860 Sep 01 15:05:40.117444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 399/800] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:39 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:05:40.827449 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a7ee73e0-6a58-4b7a-9add-5c6eabe38fc4 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] Calling method '.version_select at 0x7fab73e87d30>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:40.878983 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a7ee73e0-6a58-4b7a-9add-5c6eabe38fc4 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/ae63e9a8-110a-48ea-bd86-bb246be31a29" status: 200 len: 351 microversion: 2.1 time: 0.056686 Sep 01 15:05:40.879543 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 402/801] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 1 15:05:40 2022] GET /compute/v2.1/os-volumes/ae63e9a8-110a-48ea-bd86-bb246be31a29 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:40.893579 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c6874a45-5232-40dd-ac7f-18a6f526c668 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] Calling method '.version_select at 0x7fab7b714550>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:40.979069 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c6874a45-5232-40dd-ac7f-18a6f526c668 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090447 Sep 01 15:05:40.980166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 400/802] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Sep 1 15:05:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:40.993908 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-efe1a2a1-034a-4b62-a704-79905aecc03c tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] Calling method '.version_select at 0x7fab73cbdd30>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:41.075706 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-efe1a2a1-034a-4b62-a704-79905aecc03c tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085763 Sep 01 15:05:41.076274 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 403/803] 10.222.0.33 () {58 vars in 1149 bytes} [Thu Sep 1 15:05:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:41.089968 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3028b3c9-cfcd-479a-92ac-187830b81f8d tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] Calling method '.version_select at 0x7fab73cedca0>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:41.140487 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-094a278d-0da1-4e63-82d4-1100085cfe4f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:41.141224 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-094a278d-0da1-4e63-82d4-1100085cfe4f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:41.147922 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-094a278d-0da1-4e63-82d4-1100085cfe4f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:41.148522 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-094a278d-0da1-4e63-82d4-1100085cfe4f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:41.149165 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-094a278d-0da1-4e63-82d4-1100085cfe4f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:41.149950 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-094a278d-0da1-4e63-82d4-1100085cfe4f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:41.150514 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-094a278d-0da1-4e63-82d4-1100085cfe4f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:41.151035 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-094a278d-0da1-4e63-82d4-1100085cfe4f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:41.179345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3028b3c9-cfcd-479a-92ac-187830b81f8d tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093703 Sep 01 15:05:41.180107 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 401/804] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Sep 1 15:05:41 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:41.193696 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-be92053a-94df-4e67-8515-ecb69c044b16 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] Calling method '.version_select at 0x7fab73d99d30>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:41.276993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-be92053a-94df-4e67-8515-ecb69c044b16 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086784 Sep 01 15:05:41.277557 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 402/805] 10.222.0.33 () {58 vars in 1167 bytes} [Thu Sep 1 15:05:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:05:41.291723 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-402fd4ad-8585-4bef-b8f8-c3107d259ff4 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] Calling method '.version_select at 0x7fab73d7cb80>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:41.321456 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-094a278d-0da1-4e63-82d4-1100085cfe4f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:41.331481 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-094a278d-0da1-4e63-82d4-1100085cfe4f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1264 microversion: 2.1 time: 0.198272 Sep 01 15:05:41.332835 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 404/806] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:41 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:05:41.350464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-dec89061-a360-41d9-8f72-98f5ae4f4cbb req-37d94215-6709-46fc-9788-4904926f224d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f93b75-c5e6-4033-b466-76f23c7dc24a", "tag": "93b9430d-fd86-4cba-94ec-29862feb744c"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:41.362102 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-dec89061-a360-41d9-8f72-98f5ae4f4cbb req-37d94215-6709-46fc-9788-4904926f224d service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:41.362924 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-dec89061-a360-41d9-8f72-98f5ae4f4cbb req-37d94215-6709-46fc-9788-4904926f224d service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:41.363556 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-dec89061-a360-41d9-8f72-98f5ae4f4cbb req-37d94215-6709-46fc-9788-4904926f224d service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:41.377368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-dec89061-a360-41d9-8f72-98f5ae4f4cbb req-37d94215-6709-46fc-9788-4904926f224d service nova] Creating event network-changed:93b9430d-fd86-4cba-94ec-29862feb744c for instance e3f93b75-c5e6-4033-b466-76f23c7dc24a on hv-cinder-85505 Sep 01 15:05:41.382557 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-dec89061-a360-41d9-8f72-98f5ae4f4cbb req-37d94215-6709-46fc-9788-4904926f224d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047580 Sep 01 15:05:41.383374 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 405/807] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:41.402127 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-402fd4ad-8585-4bef-b8f8-c3107d259ff4 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.113562 Sep 01 15:05:41.402726 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 403/808] 10.222.0.33 () {58 vars in 1170 bytes} [Thu Sep 1 15:05:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:41.416182 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a55e7741-cf64-43be-9045-3e90115e8533 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] Calling method '.version_select at 0x7fab73cbdca0>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:41.501647 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a55e7741-cf64-43be-9045-3e90115e8533 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089250 Sep 01 15:05:41.501891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 406/809] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Sep 1 15:05:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:41.514944 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ff7295be-7229-4fce-b9d8-11d60ac7317f tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] Calling method '.version_select at 0x7fab73d48c10>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:41.608196 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ff7295be-7229-4fce-b9d8-11d60ac7317f tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097039 Sep 01 15:05:41.608950 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 404/810] 10.222.0.33 () {58 vars in 1188 bytes} [Thu Sep 1 15:05:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:41.621587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d6e63f46-772d-4c0f-ba8b-3fbfafac5eb3 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] Calling method '.version_select at 0x7fab73cb8ee0>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:41.730205 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d6e63f46-772d-4c0f-ba8b-3fbfafac5eb3 tempest-VolumesTestJSON-1942977842 tempest-VolumesTestJSON-1942977842-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.112305 Sep 01 15:05:41.730996 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 407/811] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Sep 1 15:05:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:42.353348 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c9450de1-6c73-4af2-a037-820f01189bf5 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:42.353964 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c9450de1-6c73-4af2-a037-820f01189bf5 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:42.360509 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9450de1-6c73-4af2-a037-820f01189bf5 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:42.360995 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9450de1-6c73-4af2-a037-820f01189bf5 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:42.361432 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9450de1-6c73-4af2-a037-820f01189bf5 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:42.362122 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9450de1-6c73-4af2-a037-820f01189bf5 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:42.362609 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9450de1-6c73-4af2-a037-820f01189bf5 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:42.363034 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9450de1-6c73-4af2-a037-820f01189bf5 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:42.551125 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c9450de1-6c73-4af2-a037-820f01189bf5 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:42.559378 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c9450de1-6c73-4af2-a037-820f01189bf5 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1264 microversion: 2.1 time: 0.210388 Sep 01 15:05:42.559935 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 405/812] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:42 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:43.580661 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9fa06959-eb5c-47cc-81ed-0ad8eeebf53b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:43.581696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9fa06959-eb5c-47cc-81ed-0ad8eeebf53b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:43.587865 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fa06959-eb5c-47cc-81ed-0ad8eeebf53b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:43.588356 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fa06959-eb5c-47cc-81ed-0ad8eeebf53b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:43.588792 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fa06959-eb5c-47cc-81ed-0ad8eeebf53b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:43.589527 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fa06959-eb5c-47cc-81ed-0ad8eeebf53b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:43.589985 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fa06959-eb5c-47cc-81ed-0ad8eeebf53b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:43.590447 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9fa06959-eb5c-47cc-81ed-0ad8eeebf53b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:43.729611 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9fa06959-eb5c-47cc-81ed-0ad8eeebf53b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:43.738027 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9fa06959-eb5c-47cc-81ed-0ad8eeebf53b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1264 microversion: 2.1 time: 0.162199 Sep 01 15:05:43.738662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 408/813] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:43 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:44.759152 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9c5cc02c-3972-417d-a001-8fbf8d294946 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:44.759772 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9c5cc02c-3972-417d-a001-8fbf8d294946 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:44.767007 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c5cc02c-3972-417d-a001-8fbf8d294946 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:44.767612 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c5cc02c-3972-417d-a001-8fbf8d294946 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:44.768071 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c5cc02c-3972-417d-a001-8fbf8d294946 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:44.768765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c5cc02c-3972-417d-a001-8fbf8d294946 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:44.769230 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c5cc02c-3972-417d-a001-8fbf8d294946 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:44.769664 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c5cc02c-3972-417d-a001-8fbf8d294946 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:44.906414 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9c5cc02c-3972-417d-a001-8fbf8d294946 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:44.915079 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9c5cc02c-3972-417d-a001-8fbf8d294946 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1264 microversion: 2.1 time: 0.159728 Sep 01 15:05:44.915656 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 406/814] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:44 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:45.937101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-79ba4168-ec6f-4740-a2ff-f0dcc80d485a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:45.937716 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-79ba4168-ec6f-4740-a2ff-f0dcc80d485a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:45.948607 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79ba4168-ec6f-4740-a2ff-f0dcc80d485a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:45.949332 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79ba4168-ec6f-4740-a2ff-f0dcc80d485a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:45.950044 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79ba4168-ec6f-4740-a2ff-f0dcc80d485a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:45.950859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79ba4168-ec6f-4740-a2ff-f0dcc80d485a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:45.951380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79ba4168-ec6f-4740-a2ff-f0dcc80d485a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:45.951932 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79ba4168-ec6f-4740-a2ff-f0dcc80d485a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:46.098171 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-79ba4168-ec6f-4740-a2ff-f0dcc80d485a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:46.107977 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-79ba4168-ec6f-4740-a2ff-f0dcc80d485a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1264 microversion: 2.1 time: 0.175455 Sep 01 15:05:46.109042 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 409/815] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:45 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:47.128881 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b5eda48e-6f26-4d89-a9c9-f1db24531078 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:47.130227 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b5eda48e-6f26-4d89-a9c9-f1db24531078 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:47.133824 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:47.138746 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5eda48e-6f26-4d89-a9c9-f1db24531078 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:47.139272 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5eda48e-6f26-4d89-a9c9-f1db24531078 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:47.139708 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5eda48e-6f26-4d89-a9c9-f1db24531078 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:47.140535 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5eda48e-6f26-4d89-a9c9-f1db24531078 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:47.140997 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5eda48e-6f26-4d89-a9c9-f1db24531078 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:47.141433 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b5eda48e-6f26-4d89-a9c9-f1db24531078 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:47.580660 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-b5eda48e-6f26-4d89-a9c9-f1db24531078 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:47.589927 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b5eda48e-6f26-4d89-a9c9-f1db24531078 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1264 microversion: 2.1 time: 0.464928 Sep 01 15:05:47.590778 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 407/816] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:47 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1264 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:48.611602 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7df2fa70-af1a-4ef9-8603-1a4706c548bb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:48.612738 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7df2fa70-af1a-4ef9-8603-1a4706c548bb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:48.619481 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7df2fa70-af1a-4ef9-8603-1a4706c548bb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:48.620781 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7df2fa70-af1a-4ef9-8603-1a4706c548bb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:48.621416 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7df2fa70-af1a-4ef9-8603-1a4706c548bb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:48.622120 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7df2fa70-af1a-4ef9-8603-1a4706c548bb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:48.622614 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7df2fa70-af1a-4ef9-8603-1a4706c548bb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:48.623042 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7df2fa70-af1a-4ef9-8603-1a4706c548bb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:48.655931 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:48.673087 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=6 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:48.781545 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-7df2fa70-af1a-4ef9-8603-1a4706c548bb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:48.789958 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7df2fa70-af1a-4ef9-8603-1a4706c548bb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1264 microversion: 2.1 time: 0.182227 Sep 01 15:05:48.790619 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 410/817] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:48 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:49.811745 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7850d234-953a-49d9-9c38-53858d9f8874 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:49.812363 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7850d234-953a-49d9-9c38-53858d9f8874 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:49.814419 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:49.819805 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7850d234-953a-49d9-9c38-53858d9f8874 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:49.820293 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7850d234-953a-49d9-9c38-53858d9f8874 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:49.820731 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7850d234-953a-49d9-9c38-53858d9f8874 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:49.821426 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7850d234-953a-49d9-9c38-53858d9f8874 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:49.821887 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7850d234-953a-49d9-9c38-53858d9f8874 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:49.822342 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7850d234-953a-49d9-9c38-53858d9f8874 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:50.007123 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7850d234-953a-49d9-9c38-53858d9f8874 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:50.016038 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7850d234-953a-49d9-9c38-53858d9f8874 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1264 microversion: 2.1 time: 0.208658 Sep 01 15:05:50.017720 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 408/818] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:49 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:51.037834 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cf1a84f5-9329-447b-b843-002bfe9dfd72 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:51.038777 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-cf1a84f5-9329-447b-b843-002bfe9dfd72 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:51.041083 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:05:51.046735 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf1a84f5-9329-447b-b843-002bfe9dfd72 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:51.047227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf1a84f5-9329-447b-b843-002bfe9dfd72 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:51.047672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf1a84f5-9329-447b-b843-002bfe9dfd72 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:51.048407 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf1a84f5-9329-447b-b843-002bfe9dfd72 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:51.048874 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf1a84f5-9329-447b-b843-002bfe9dfd72 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:51.049365 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cf1a84f5-9329-447b-b843-002bfe9dfd72 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:51.187101 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-cf1a84f5-9329-447b-b843-002bfe9dfd72 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:51.195227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cf1a84f5-9329-447b-b843-002bfe9dfd72 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1264 microversion: 2.1 time: 0.161328 Sep 01 15:05:51.195852 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 411/819] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:51 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:52.017884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-2ddd7aa1-a2c7-49f3-85a2-d23ef9d3cdbc req-7c9b225c-f652-40f0-abb7-828433f43181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f93b75-c5e6-4033-b466-76f23c7dc24a", "name": "network-vif-plugged", "status": "completed", "tag": "93b9430d-fd86-4cba-94ec-29862feb744c"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:52.029246 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-2ddd7aa1-a2c7-49f3-85a2-d23ef9d3cdbc req-7c9b225c-f652-40f0-abb7-828433f43181 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:52.029750 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-2ddd7aa1-a2c7-49f3-85a2-d23ef9d3cdbc req-7c9b225c-f652-40f0-abb7-828433f43181 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:52.030405 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-2ddd7aa1-a2c7-49f3-85a2-d23ef9d3cdbc req-7c9b225c-f652-40f0-abb7-828433f43181 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:52.042275 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-2ddd7aa1-a2c7-49f3-85a2-d23ef9d3cdbc req-7c9b225c-f652-40f0-abb7-828433f43181 service nova] Creating event network-vif-plugged:93b9430d-fd86-4cba-94ec-29862feb744c for instance e3f93b75-c5e6-4033-b466-76f23c7dc24a on hv-cinder-85505 Sep 01 15:05:52.048666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-2ddd7aa1-a2c7-49f3-85a2-d23ef9d3cdbc req-7c9b225c-f652-40f0-abb7-828433f43181 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034875 Sep 01 15:05:52.049435 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 409/820] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:05:52.216287 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ec58d220-b8ef-4f02-a49a-574cbfa7c400 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:52.216873 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ec58d220-b8ef-4f02-a49a-574cbfa7c400 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:52.223241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec58d220-b8ef-4f02-a49a-574cbfa7c400 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:52.223731 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec58d220-b8ef-4f02-a49a-574cbfa7c400 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:52.224172 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec58d220-b8ef-4f02-a49a-574cbfa7c400 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:52.224864 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec58d220-b8ef-4f02-a49a-574cbfa7c400 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:52.225323 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec58d220-b8ef-4f02-a49a-574cbfa7c400 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:52.225750 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ec58d220-b8ef-4f02-a49a-574cbfa7c400 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:52.359227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ec58d220-b8ef-4f02-a49a-574cbfa7c400 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:52.366768 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ec58d220-b8ef-4f02-a49a-574cbfa7c400 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1264 microversion: 2.1 time: 0.154458 Sep 01 15:05:52.367322 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 412/821] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:52 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:53.388794 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ed8809ba-be94-41ac-9b1c-ae79a5a6b4a3 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:53.389652 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ed8809ba-be94-41ac-9b1c-ae79a5a6b4a3 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:53.396439 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ed8809ba-be94-41ac-9b1c-ae79a5a6b4a3 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:53.397169 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ed8809ba-be94-41ac-9b1c-ae79a5a6b4a3 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:53.397867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ed8809ba-be94-41ac-9b1c-ae79a5a6b4a3 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:53.398842 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ed8809ba-be94-41ac-9b1c-ae79a5a6b4a3 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:53.399402 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ed8809ba-be94-41ac-9b1c-ae79a5a6b4a3 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:53.399921 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ed8809ba-be94-41ac-9b1c-ae79a5a6b4a3 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:53.549620 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ed8809ba-be94-41ac-9b1c-ae79a5a6b4a3 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:53.558640 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ed8809ba-be94-41ac-9b1c-ae79a5a6b4a3 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1452 microversion: 2.1 time: 0.174481 Sep 01 15:05:53.559294 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 410/822] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:53 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:05:53.578162 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5ac899be-57b5-487f-97a9-d2671936becc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:05:53.578808 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5ac899be-57b5-487f-97a9-d2671936becc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:05:53.585033 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5ac899be-57b5-487f-97a9-d2671936becc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:53.585501 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5ac899be-57b5-487f-97a9-d2671936becc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:53.585934 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5ac899be-57b5-487f-97a9-d2671936becc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:53.586647 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5ac899be-57b5-487f-97a9-d2671936becc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:53.587098 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5ac899be-57b5-487f-97a9-d2671936becc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:53.587521 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5ac899be-57b5-487f-97a9-d2671936becc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:53.720273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-5ac899be-57b5-487f-97a9-d2671936becc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:05:53.727893 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5ac899be-57b5-487f-97a9-d2671936becc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1452 microversion: 2.1 time: 0.153520 Sep 01 15:05:53.728446 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 413/823] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:05:53 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:05:55.659829 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-0788d29c-c32d-4838-9fff-10e5510ec6e2 req-38efc363-7b59-4186-8cef-70322c93a1e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f93b75-c5e6-4033-b466-76f23c7dc24a", "tag": "93b9430d-fd86-4cba-94ec-29862feb744c"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:05:55.672993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-0788d29c-c32d-4838-9fff-10e5510ec6e2 req-38efc363-7b59-4186-8cef-70322c93a1e1 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:05:55.673669 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-0788d29c-c32d-4838-9fff-10e5510ec6e2 req-38efc363-7b59-4186-8cef-70322c93a1e1 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:05:55.674348 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-0788d29c-c32d-4838-9fff-10e5510ec6e2 req-38efc363-7b59-4186-8cef-70322c93a1e1 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:05:55.685992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-0788d29c-c32d-4838-9fff-10e5510ec6e2 req-38efc363-7b59-4186-8cef-70322c93a1e1 service nova] Creating event network-changed:93b9430d-fd86-4cba-94ec-29862feb744c for instance e3f93b75-c5e6-4033-b466-76f23c7dc24a on hv-cinder-85505 Sep 01 15:05:55.691514 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-0788d29c-c32d-4838-9fff-10e5510ec6e2 req-38efc363-7b59-4186-8cef-70322c93a1e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035635 Sep 01 15:05:55.692162 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 411/824] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:05.913219 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5c402e05-3ec3-443b-963c-30990489b2f7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:05.913716 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5c402e05-3ec3-443b-963c-30990489b2f7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:05.915957 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=5 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:05.916721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=57 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:05.923978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5c402e05-3ec3-443b-963c-30990489b2f7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:05.924470 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5c402e05-3ec3-443b-963c-30990489b2f7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:05.924911 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5c402e05-3ec3-443b-963c-30990489b2f7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:05.925617 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5c402e05-3ec3-443b-963c-30990489b2f7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:05.926072 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5c402e05-3ec3-443b-963c-30990489b2f7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:05.926542 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5c402e05-3ec3-443b-963c-30990489b2f7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:05.951170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5c402e05-3ec3-443b-963c-30990489b2f7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98/ips" status: 200 len: 151 microversion: 2.1 time: 0.041790 Sep 01 15:06:05.951743 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 414/825] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 1 15:06:05 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:06:05.961283 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=9 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:05.962134 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=47 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:05.966658 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f3e0117-1ea5-49f3-970b-0df92decc413"}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:05.969080 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:05.976626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:05.977118 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:05.977560 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:05.978286 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:05.978750 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:05.979222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:06.059162 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Invalid volume: volume 0f3e0117-1ea5-49f3-970b-0df92decc413 is already attached to instances: 550286be-d749-4dff-9def-2d2a3bb0a283 Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: POST /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98/os-volume_attachments HTTP/1.1 Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 74 Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:06:06.060992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {"volumeAttachment": {"volumeId": "0f3e0117-1ea5-49f3-970b-0df92decc413"}} Sep 01 15:06:06.062727 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Invalid volume: volume 0f3e0117-1ea5-49f3-970b-0df92decc413 is already attached to instances: 550286be-d749-4dff-9def-2d2a3bb0a283 Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'server_id': '352d9545-b008-461c-b5ed-c95887f86e98', 'body': {'volumeAttachment': {'volumeId': '0f3e0117-1ea5-49f3-970b-0df92decc413'}}} Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0f3e0117-1ea5-49f3-970b-0df92decc413 is already attached to instances: 550286be-d749-4dff-9def-2d2a3bb0a283 Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:06:06.063606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0f3e0117-1ea5-49f3-970b-0df92decc413 is already attached to instances: 550286be-d749-4dff-9def-2d2a3bb0a283 Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:06:06.064854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:06:06.066282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:06:06.066282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:06:06.066282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:06:06.066282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0f3e0117-1ea5-49f3-970b-0df92decc413 is already attached to instances: 550286be-d749-4dff-9def-2d2a3bb0a283 Sep 01 15:06:06.066282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:06:06.066282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 400 to user: Invalid volume: volume 0f3e0117-1ea5-49f3-970b-0df92decc413 is already attached to instances: 550286be-d749-4dff-9def-2d2a3bb0a283 {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:06:06.066282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-1b54bcf9-ae81-4875-a798-0a160ac4e746 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103124 Sep 01 15:06:06.066282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 412/826] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:06:05 2022] POST /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 15:06:06.075917 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-53da37e5-96e6-436f-b740-88f04356d990 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:06.076419 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-53da37e5-96e6-436f-b740-88f04356d990 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:06.082370 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-53da37e5-96e6-436f-b740-88f04356d990 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:06.082864 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-53da37e5-96e6-436f-b740-88f04356d990 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:06.083311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-53da37e5-96e6-436f-b740-88f04356d990 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:06.084007 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-53da37e5-96e6-436f-b740-88f04356d990 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:06.084468 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-53da37e5-96e6-436f-b740-88f04356d990 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:06.084900 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-53da37e5-96e6-436f-b740-88f04356d990 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:06.112109 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-53da37e5-96e6-436f-b740-88f04356d990 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Going to try to terminate instance {{(pid=120553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:06:06.191988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-53da37e5-96e6-436f-b740-88f04356d990 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 204 len: 0 microversion: 2.1 time: 0.120457 Sep 01 15:06:06.192669 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 415/827] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:06:06 2022] DELETE /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:06:06.201683 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6a9f4c71-55f8-425d-b6a4-98469effc255 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:06.202333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6a9f4c71-55f8-425d-b6a4-98469effc255 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:06.210178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a9f4c71-55f8-425d-b6a4-98469effc255 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:06.210735 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a9f4c71-55f8-425d-b6a4-98469effc255 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:06.211181 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a9f4c71-55f8-425d-b6a4-98469effc255 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:06.215012 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a9f4c71-55f8-425d-b6a4-98469effc255 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:06.215012 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a9f4c71-55f8-425d-b6a4-98469effc255 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:06.215012 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a9f4c71-55f8-425d-b6a4-98469effc255 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:06.399420 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6a9f4c71-55f8-425d-b6a4-98469effc255 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:06.407715 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6a9f4c71-55f8-425d-b6a4-98469effc255 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1684 microversion: 2.1 time: 0.210382 Sep 01 15:06:06.408488 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 413/828] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:06 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1684 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:07.431863 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d148983a-51f0-46d4-ad30-0ce1621be403 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:07.433176 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d148983a-51f0-46d4-ad30-0ce1621be403 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:07.440155 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d148983a-51f0-46d4-ad30-0ce1621be403 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:07.440645 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d148983a-51f0-46d4-ad30-0ce1621be403 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:07.441221 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d148983a-51f0-46d4-ad30-0ce1621be403 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:07.441836 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d148983a-51f0-46d4-ad30-0ce1621be403 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:07.442361 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d148983a-51f0-46d4-ad30-0ce1621be403 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:07.442789 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d148983a-51f0-46d4-ad30-0ce1621be403 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:07.582559 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d148983a-51f0-46d4-ad30-0ce1621be403 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:07.591233 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d148983a-51f0-46d4-ad30-0ce1621be403 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1684 microversion: 2.1 time: 0.163505 Sep 01 15:06:07.591831 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 416/829] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:07 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:06:08.620391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a933d98d-4ef9-4a9a-a45e-64f1fe508b25 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:08.620947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a933d98d-4ef9-4a9a-a45e-64f1fe508b25 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:08.627435 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a933d98d-4ef9-4a9a-a45e-64f1fe508b25 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:08.627924 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a933d98d-4ef9-4a9a-a45e-64f1fe508b25 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:08.628364 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a933d98d-4ef9-4a9a-a45e-64f1fe508b25 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:08.629080 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a933d98d-4ef9-4a9a-a45e-64f1fe508b25 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:08.629544 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a933d98d-4ef9-4a9a-a45e-64f1fe508b25 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:08.629972 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a933d98d-4ef9-4a9a-a45e-64f1fe508b25 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:08.756961 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a933d98d-4ef9-4a9a-a45e-64f1fe508b25 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:08.765169 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a933d98d-4ef9-4a9a-a45e-64f1fe508b25 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1684 microversion: 2.1 time: 0.148788 Sep 01 15:06:08.765726 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 414/830] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:08 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:09.786971 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c94916a3-7f0c-4766-8adc-ea20d0ead5a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:09.787598 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c94916a3-7f0c-4766-8adc-ea20d0ead5a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:09.794725 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c94916a3-7f0c-4766-8adc-ea20d0ead5a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:09.795482 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c94916a3-7f0c-4766-8adc-ea20d0ead5a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:09.795927 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c94916a3-7f0c-4766-8adc-ea20d0ead5a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:09.796618 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c94916a3-7f0c-4766-8adc-ea20d0ead5a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:09.797083 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c94916a3-7f0c-4766-8adc-ea20d0ead5a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:09.797520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c94916a3-7f0c-4766-8adc-ea20d0ead5a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:09.928554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c94916a3-7f0c-4766-8adc-ea20d0ead5a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:09.936376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c94916a3-7f0c-4766-8adc-ea20d0ead5a8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1684 microversion: 2.1 time: 0.153232 Sep 01 15:06:09.936938 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 417/831] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:09 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:10.893406 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-f7a23e42-8569-436d-ab63-4fbbe623df29 req-01b299fe-aa2a-4e28-ad69-a0c733cfe126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "352d9545-b008-461c-b5ed-c95887f86e98", "name": "network-vif-deleted", "tag": "25d84137-f847-437d-b4ba-c5af2d246e8a"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:10.903330 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-f7a23e42-8569-436d-ab63-4fbbe623df29 req-01b299fe-aa2a-4e28-ad69-a0c733cfe126 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:10.903892 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-f7a23e42-8569-436d-ab63-4fbbe623df29 req-01b299fe-aa2a-4e28-ad69-a0c733cfe126 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:10.904328 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-f7a23e42-8569-436d-ab63-4fbbe623df29 req-01b299fe-aa2a-4e28-ad69-a0c733cfe126 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:10.915388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-f7a23e42-8569-436d-ab63-4fbbe623df29 req-01b299fe-aa2a-4e28-ad69-a0c733cfe126 service nova] Creating event network-vif-deleted:25d84137-f847-437d-b4ba-c5af2d246e8a for instance 352d9545-b008-461c-b5ed-c95887f86e98 on hv-cinder-85505 Sep 01 15:06:10.921068 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-f7a23e42-8569-436d-ab63-4fbbe623df29 req-01b299fe-aa2a-4e28-ad69-a0c733cfe126 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031668 Sep 01 15:06:10.921651 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 415/832] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:10.957125 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-35e1a3ff-87d5-477b-b875-67e15aab7640 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:10.958023 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-35e1a3ff-87d5-477b-b875-67e15aab7640 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:10.964516 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35e1a3ff-87d5-477b-b875-67e15aab7640 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:10.965009 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35e1a3ff-87d5-477b-b875-67e15aab7640 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:10.965451 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35e1a3ff-87d5-477b-b875-67e15aab7640 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:10.966163 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35e1a3ff-87d5-477b-b875-67e15aab7640 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:10.966645 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35e1a3ff-87d5-477b-b875-67e15aab7640 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:10.967066 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-35e1a3ff-87d5-477b-b875-67e15aab7640 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:11.038359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-35e1a3ff-87d5-477b-b875-67e15aab7640 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:11.049601 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-35e1a3ff-87d5-477b-b875-67e15aab7640 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1616 microversion: 2.1 time: 0.096383 Sep 01 15:06:11.050798 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 418/833] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:10 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1616 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:12.073695 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-45024fc4-9676-43c5-bf91-48d3a39e05c7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:12.074446 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-45024fc4-9676-43c5-bf91-48d3a39e05c7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:12.080560 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-45024fc4-9676-43c5-bf91-48d3a39e05c7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:12.081039 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-45024fc4-9676-43c5-bf91-48d3a39e05c7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:12.081471 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-45024fc4-9676-43c5-bf91-48d3a39e05c7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:12.082155 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-45024fc4-9676-43c5-bf91-48d3a39e05c7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:12.082639 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-45024fc4-9676-43c5-bf91-48d3a39e05c7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:12.083064 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-45024fc4-9676-43c5-bf91-48d3a39e05c7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:12.144761 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-45024fc4-9676-43c5-bf91-48d3a39e05c7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:12.152429 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-45024fc4-9676-43c5-bf91-48d3a39e05c7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1327 microversion: 2.1 time: 0.084072 Sep 01 15:06:12.152993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 416/834] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:12 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1327 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:13.173192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:13.174010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:13.180588 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:13.181180 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:13.181664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:13.182415 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:13.182870 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:13.183303 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:13.215676 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:13.216162 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:13.216600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:13.217045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lazy-loading 'fault' on Instance uuid 352d9545-b008-461c-b5ed-c95887f86e98 {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:06:13.261347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:13.270219 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-0842b90d-6f58-4eba-accc-8d3e736e9633 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 200 len: 1332 microversion: 2.1 time: 0.101129 Sep 01 15:06:13.270811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 419/835] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:13 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:14.294077 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:14.294657 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:14.301393 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:14.301885 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:14.302353 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:14.303044 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:14.303512 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:14.303922 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:14.316920 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 HTTP/1.1 Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:06:14.318563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:06:14.320218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '352d9545-b008-461c-b5ed-c95887f86e98'} Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:06:14.321686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:06:14.324570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:06:14.326006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:06:14.326006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a2490383-ddd7-44e7-972d-2c18e0af5311 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 404 len: 111 microversion: 2.1 time: 0.030488 Sep 01 15:06:14.326006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 417/836] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:14 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:06:14.328943 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cc2724e9-c891-4f59-a7b2-ae8f3a44b312 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '.version_select at 0x7fab73cb8550>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:14.349593 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cc2724e9-c891-4f59-a7b2-ae8f3a44b312 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898720770" status: 202 len: 0 microversion: 2.1 time: 0.024649 Sep 01 15:06:14.350161 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 420/837] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Sep 1 15:06:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898720770 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:06:15.028192 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a4492b9f-588d-45c2-8865-0611912151c9 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:15.028686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a4492b9f-588d-45c2-8865-0611912151c9 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:15.034528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4492b9f-588d-45c2-8865-0611912151c9 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:15.035018 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4492b9f-588d-45c2-8865-0611912151c9 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:15.035460 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4492b9f-588d-45c2-8865-0611912151c9 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:15.036156 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4492b9f-588d-45c2-8865-0611912151c9 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:15.036615 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4492b9f-588d-45c2-8865-0611912151c9 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:15.037044 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4492b9f-588d-45c2-8865-0611912151c9 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:15.126576 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.objects.instance [None req-a4492b9f-588d-45c2-8865-0611912151c9 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lazy-loading 'services' on Instance uuid 550286be-d749-4dff-9def-2d2a3bb0a283 {{(pid=120554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:06:15.230061 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a4492b9f-588d-45c2-8865-0611912151c9 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/os-volume_attachments/0f3e0117-1ea5-49f3-970b-0df92decc413" status: 202 len: 0 microversion: 2.1 time: 0.205542 Sep 01 15:06:15.230833 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 418/838] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:06:15 2022] DELETE /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/os-volume_attachments/0f3e0117-1ea5-49f3-970b-0df92decc413 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:06:15.239159 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d644fb63-a898-4f26-b408-687296254aba tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:15.241332 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d644fb63-a898-4f26-b408-687296254aba tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:15.248955 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d644fb63-a898-4f26-b408-687296254aba tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:15.249452 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d644fb63-a898-4f26-b408-687296254aba tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:15.250169 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d644fb63-a898-4f26-b408-687296254aba tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:15.251041 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d644fb63-a898-4f26-b408-687296254aba tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:15.251497 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d644fb63-a898-4f26-b408-687296254aba tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:15.251928 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d644fb63-a898-4f26-b408-687296254aba tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:15.284645 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d644fb63-a898-4f26-b408-687296254aba tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049440 Sep 01 15:06:15.285200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 421/839] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:06:15 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:16.299757 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-dc9a8f5e-0a49-4927-8c76-e3d318a21a11 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:16.302336 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-dc9a8f5e-0a49-4927-8c76-e3d318a21a11 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:16.310164 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dc9a8f5e-0a49-4927-8c76-e3d318a21a11 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:16.310971 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dc9a8f5e-0a49-4927-8c76-e3d318a21a11 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:16.311502 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dc9a8f5e-0a49-4927-8c76-e3d318a21a11 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:16.312223 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dc9a8f5e-0a49-4927-8c76-e3d318a21a11 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:16.312766 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dc9a8f5e-0a49-4927-8c76-e3d318a21a11 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:16.313115 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dc9a8f5e-0a49-4927-8c76-e3d318a21a11 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:16.349550 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-dc9a8f5e-0a49-4927-8c76-e3d318a21a11 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055025 Sep 01 15:06:16.350303 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 419/840] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:06:16 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 15:06:16.445446 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ce4315ca-407d-4753-b099-cf6478c22ebc tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:16.446595 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ce4315ca-407d-4753-b099-cf6478c22ebc tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:16.454347 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce4315ca-407d-4753-b099-cf6478c22ebc tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:16.455187 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce4315ca-407d-4753-b099-cf6478c22ebc tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:16.455860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce4315ca-407d-4753-b099-cf6478c22ebc tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:16.457105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce4315ca-407d-4753-b099-cf6478c22ebc tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:16.457671 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce4315ca-407d-4753-b099-cf6478c22ebc tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:16.458355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ce4315ca-407d-4753-b099-cf6478c22ebc tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:16.491464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ce4315ca-407d-4753-b099-cf6478c22ebc tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Going to try to terminate instance {{(pid=120553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:06:16.592818 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ce4315ca-407d-4753-b099-cf6478c22ebc tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 204 len: 0 microversion: 2.1 time: 0.151213 Sep 01 15:06:16.598142 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 422/841] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:06:16 2022] DELETE /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:06:16.603690 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7dd2403e-8c09-4e2c-8ae1-d23b0213c532 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:16.604670 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7dd2403e-8c09-4e2c-8ae1-d23b0213c532 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:16.615086 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dd2403e-8c09-4e2c-8ae1-d23b0213c532 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:16.615722 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dd2403e-8c09-4e2c-8ae1-d23b0213c532 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:16.623621 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dd2403e-8c09-4e2c-8ae1-d23b0213c532 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:16.626284 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dd2403e-8c09-4e2c-8ae1-d23b0213c532 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:16.627829 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dd2403e-8c09-4e2c-8ae1-d23b0213c532 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:16.628620 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7dd2403e-8c09-4e2c-8ae1-d23b0213c532 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:16.840079 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7dd2403e-8c09-4e2c-8ae1-d23b0213c532 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:16.850434 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7dd2403e-8c09-4e2c-8ae1-d23b0213c532 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1681 microversion: 2.1 time: 0.251643 Sep 01 15:06:16.851406 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 420/842] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:16 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:17.847851 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-dcd73d3a-b2e4-4832-b003-301b9b67acfb tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:17.848482 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-dcd73d3a-b2e4-4832-b003-301b9b67acfb tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:17.855827 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dcd73d3a-b2e4-4832-b003-301b9b67acfb tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:17.856829 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dcd73d3a-b2e4-4832-b003-301b9b67acfb tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:17.857582 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dcd73d3a-b2e4-4832-b003-301b9b67acfb tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:17.858760 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dcd73d3a-b2e4-4832-b003-301b9b67acfb tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:17.859414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dcd73d3a-b2e4-4832-b003-301b9b67acfb tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:17.860346 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-dcd73d3a-b2e4-4832-b003-301b9b67acfb tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:17.875587 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ff9bc57c-58d0-47de-b2fa-c7ecc7e20f34 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:17.876213 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ff9bc57c-58d0-47de-b2fa-c7ecc7e20f34 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:17.889979 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ff9bc57c-58d0-47de-b2fa-c7ecc7e20f34 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:17.890932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ff9bc57c-58d0-47de-b2fa-c7ecc7e20f34 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:17.891552 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ff9bc57c-58d0-47de-b2fa-c7ecc7e20f34 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:17.892464 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ff9bc57c-58d0-47de-b2fa-c7ecc7e20f34 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:17.893099 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ff9bc57c-58d0-47de-b2fa-c7ecc7e20f34 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:17.893692 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ff9bc57c-58d0-47de-b2fa-c7ecc7e20f34 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:17.896768 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-dcd73d3a-b2e4-4832-b003-301b9b67acfb tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lazy-loading 'flavor' on Instance uuid d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:06:18.029366 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-dcd73d3a-b2e4-4832-b003-301b9b67acfb tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "POST /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a/action" status: 202 len: 0 microversion: 2.1 time: 0.186042 Sep 01 15:06:18.030573 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 423/843] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:06:17 2022] POST /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 15:06:18.042386 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-eb7b8141-d914-4412-b328-6548de688bb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:18.043606 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-eb7b8141-d914-4412-b328-6548de688bb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:18.066566 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb7b8141-d914-4412-b328-6548de688bb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:18.067494 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb7b8141-d914-4412-b328-6548de688bb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:18.068939 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb7b8141-d914-4412-b328-6548de688bb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:18.070019 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb7b8141-d914-4412-b328-6548de688bb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:18.071627 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb7b8141-d914-4412-b328-6548de688bb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:18.072896 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-eb7b8141-d914-4412-b328-6548de688bb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:18.112366 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ff9bc57c-58d0-47de-b2fa-c7ecc7e20f34 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:18.126110 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ff9bc57c-58d0-47de-b2fa-c7ecc7e20f34 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1681 microversion: 2.1 time: 0.254539 Sep 01 15:06:18.144830 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 421/844] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:17 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1681 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:18.281759 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-eb7b8141-d914-4412-b328-6548de688bb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:18.290344 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-eb7b8141-d914-4412-b328-6548de688bb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.254807 Sep 01 15:06:18.291259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 424/845] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:18 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:19.151028 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-19b6481b-e338-4398-86a6-53f9d077f4b0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:19.152231 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-19b6481b-e338-4398-86a6-53f9d077f4b0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:19.158752 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-19b6481b-e338-4398-86a6-53f9d077f4b0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:19.159465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-19b6481b-e338-4398-86a6-53f9d077f4b0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:19.159955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-19b6481b-e338-4398-86a6-53f9d077f4b0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:19.160621 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-19b6481b-e338-4398-86a6-53f9d077f4b0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:19.161068 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-19b6481b-e338-4398-86a6-53f9d077f4b0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:19.161678 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-19b6481b-e338-4398-86a6-53f9d077f4b0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:19.314028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ebbcf833-79f0-4b95-bf8d-810b4dfdfd74 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:19.314672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ebbcf833-79f0-4b95-bf8d-810b4dfdfd74 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:19.322822 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ebbcf833-79f0-4b95-bf8d-810b4dfdfd74 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:19.324054 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ebbcf833-79f0-4b95-bf8d-810b4dfdfd74 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:19.324666 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ebbcf833-79f0-4b95-bf8d-810b4dfdfd74 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:19.325378 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ebbcf833-79f0-4b95-bf8d-810b4dfdfd74 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:19.325982 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ebbcf833-79f0-4b95-bf8d-810b4dfdfd74 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:19.326890 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ebbcf833-79f0-4b95-bf8d-810b4dfdfd74 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:19.458024 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-19b6481b-e338-4398-86a6-53f9d077f4b0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:19.470620 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-19b6481b-e338-4398-86a6-53f9d077f4b0 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1681 microversion: 2.1 time: 0.323011 Sep 01 15:06:19.487256 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 422/846] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:19 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1681 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:19.498601 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ebbcf833-79f0-4b95-bf8d-810b4dfdfd74 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:19.507936 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ebbcf833-79f0-4b95-bf8d-810b4dfdfd74 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.197586 Sep 01 15:06:19.508476 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 425/847] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:19 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:06:20.164197 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-6bd6dddc-4a1e-4cf8-93fe-e31f68c0527a req-ec401fba-1c0a-43a0-b0c4-eec15aa1fa36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550286be-d749-4dff-9def-2d2a3bb0a283", "name": "network-vif-deleted", "tag": "f3c5bb5e-6c48-417b-b600-221425800d79"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:20.185904 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-6bd6dddc-4a1e-4cf8-93fe-e31f68c0527a req-ec401fba-1c0a-43a0-b0c4-eec15aa1fa36 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:20.187108 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-6bd6dddc-4a1e-4cf8-93fe-e31f68c0527a req-ec401fba-1c0a-43a0-b0c4-eec15aa1fa36 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:20.187879 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-6bd6dddc-4a1e-4cf8-93fe-e31f68c0527a req-ec401fba-1c0a-43a0-b0c4-eec15aa1fa36 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:20.220974 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-6bd6dddc-4a1e-4cf8-93fe-e31f68c0527a req-ec401fba-1c0a-43a0-b0c4-eec15aa1fa36 service nova] Creating event network-vif-deleted:f3c5bb5e-6c48-417b-b600-221425800d79 for instance 550286be-d749-4dff-9def-2d2a3bb0a283 on hv-cinder-85505 Sep 01 15:06:20.231544 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-6bd6dddc-4a1e-4cf8-93fe-e31f68c0527a req-ec401fba-1c0a-43a0-b0c4-eec15aa1fa36 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071305 Sep 01 15:06:20.232168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 423/848] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:20.494325 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:20.495395 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:20.524455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:20.528186 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:20.528648 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:20.531190 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0bea72d1-c57f-4681-b6f2-fb2fd9e93b98 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:20.531607 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:20.531810 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0bea72d1-c57f-4681-b6f2-fb2fd9e93b98 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:20.532320 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:20.532689 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:20.541469 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:20.553630 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0bea72d1-c57f-4681-b6f2-fb2fd9e93b98 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:20.554123 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0bea72d1-c57f-4681-b6f2-fb2fd9e93b98 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:20.556117 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0bea72d1-c57f-4681-b6f2-fb2fd9e93b98 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:20.561488 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0bea72d1-c57f-4681-b6f2-fb2fd9e93b98 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:20.562136 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0bea72d1-c57f-4681-b6f2-fb2fd9e93b98 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:20.562748 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0bea72d1-c57f-4681-b6f2-fb2fd9e93b98 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:20.598511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:20.599350 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:20.600296 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:20.601004 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lazy-loading 'fault' on Instance uuid 550286be-d749-4dff-9def-2d2a3bb0a283 {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:06:20.654041 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:20.670915 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1702ceeb-ccfa-439d-9b9b-6eb908783eb2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 200 len: 1331 microversion: 2.1 time: 0.181503 Sep 01 15:06:20.672211 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 426/849] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:20 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 1331 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:20.856673 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0bea72d1-c57f-4681-b6f2-fb2fd9e93b98 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:20.865359 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0bea72d1-c57f-4681-b6f2-fb2fd9e93b98 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.339262 Sep 01 15:06:20.886293 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 424/850] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:20 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:21.697130 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:21.699071 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:21.707568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:21.708667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:21.709414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:21.710471 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:21.711034 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:21.711547 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:21.726099 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 HTTP/1.1 Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:06:21.728003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:06:21.730981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '550286be-d749-4dff-9def-2d2a3bb0a283'} Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:06:21.731914 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:06:21.733793 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:06:21.735983 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:06:21.737045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c224a44e-2c88-4493-b78a-cef72c76b4c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 404 len: 111 microversion: 2.1 time: 0.047746 Sep 01 15:06:21.742090 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 427/851] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:21 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:06:21.746967 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-8733d5a8-1710-423c-927b-6c8f44b7d317 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '.version_select at 0x7fab73cc89d0>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:21.771168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-8733d5a8-1710-423c-927b-6c8f44b7d317 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-127803300" status: 202 len: 0 microversion: 2.1 time: 0.028698 Sep 01 15:06:21.771837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 425/852] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Sep 1 15:06:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-127803300 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:06:21.895591 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a33b8414-aa6d-4682-b61d-ee73d6e0a4aa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:21.896203 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a33b8414-aa6d-4682-b61d-ee73d6e0a4aa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:21.906200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a33b8414-aa6d-4682-b61d-ee73d6e0a4aa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:21.906798 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a33b8414-aa6d-4682-b61d-ee73d6e0a4aa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:21.907473 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a33b8414-aa6d-4682-b61d-ee73d6e0a4aa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:21.910046 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a33b8414-aa6d-4682-b61d-ee73d6e0a4aa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:21.911667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a33b8414-aa6d-4682-b61d-ee73d6e0a4aa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:21.912886 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a33b8414-aa6d-4682-b61d-ee73d6e0a4aa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:22.191020 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a33b8414-aa6d-4682-b61d-ee73d6e0a4aa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:22.202890 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a33b8414-aa6d-4682-b61d-ee73d6e0a4aa tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.311709 Sep 01 15:06:22.204331 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 428/853] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:21 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:23.167595 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2421e350-bea2-4bdc-9f7d-41375f7a3787 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: .version_select at 0x7fab73e9a280>, body: {"keypair": {"name": "tempest-keypair-1541414469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG6OpFGp+Hw8RgMJH+ycWyLIaO3NrLiLtmipyCIeSakiZNX/C47SUO6SQ5nNnLbJ3bdUNxBc/HFfei9yKo0MrVdRb0Wwa5y74dnAh3nhd/nKHS7SvPBk3cHDN04E0K/Eg=="}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:23.185932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-2421e350-bea2-4bdc-9f7d-41375f7a3787 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for project 0b789cb75bc24a898888246a7745537e. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:06:23.190391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-2421e350-bea2-4bdc-9f7d-41375f7a3787 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for user 27653498cd0a4e089f1cbc43470182ee and project 0b789cb75bc24a898888246a7745537e. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:06:23.216678 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2421e350-bea2-4bdc-9f7d-41375f7a3787 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054256 Sep 01 15:06:23.217286 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 426/854] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 1 15:06:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:23.229937 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8e4c9a09-3f78-4298-8662-788d4bc12662 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:23.231229 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8e4c9a09-3f78-4298-8662-788d4bc12662 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:23.238592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8e4c9a09-3f78-4298-8662-788d4bc12662 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:23.239194 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8e4c9a09-3f78-4298-8662-788d4bc12662 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:23.239713 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8e4c9a09-3f78-4298-8662-788d4bc12662 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:23.240488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8e4c9a09-3f78-4298-8662-788d4bc12662 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:23.241199 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8e4c9a09-3f78-4298-8662-788d4bc12662 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:23.241822 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8e4c9a09-3f78-4298-8662-788d4bc12662 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:23.459382 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8e4c9a09-3f78-4298-8662-788d4bc12662 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:23.473369 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8e4c9a09-3f78-4298-8662-788d4bc12662 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.248039 Sep 01 15:06:23.473943 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 429/855] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:23 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:24.510866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-99d5675d-66e6-459a-9d51-52e976c85ee8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:24.513633 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-99d5675d-66e6-459a-9d51-52e976c85ee8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:24.528959 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99d5675d-66e6-459a-9d51-52e976c85ee8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:24.529457 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99d5675d-66e6-459a-9d51-52e976c85ee8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:24.529899 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99d5675d-66e6-459a-9d51-52e976c85ee8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:24.530645 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99d5675d-66e6-459a-9d51-52e976c85ee8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:24.531112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99d5675d-66e6-459a-9d51-52e976c85ee8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:24.531535 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99d5675d-66e6-459a-9d51-52e976c85ee8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:24.882721 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-99d5675d-66e6-459a-9d51-52e976c85ee8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:24.896079 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-99d5675d-66e6-459a-9d51-52e976c85ee8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.396622 Sep 01 15:06:24.896668 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 427/856] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:24 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:25.133417 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-233340144", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf8cd5c2-fc41-47d1-b1ef-d6d4b64d51b6"}], "security_groups": [{"name": "tempest-securitygroup--880631426"}], "key_name": "tempest-keypair-1541414469", "user_data": "}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:25.344678 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.network.neutron [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] validate_networks() for [('bf8cd5c2-fc41-47d1-b1ef-d6d4b64d51b6', None, None, None, None, None)] {{(pid=120553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:06:25.917345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ee513738-2b6b-40c3-801b-0f6963c1e559 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:25.917969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ee513738-2b6b-40c3-801b-0f6963c1e559 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:25.937284 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee513738-2b6b-40c3-801b-0f6963c1e559 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:25.937795 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee513738-2b6b-40c3-801b-0f6963c1e559 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:25.938269 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee513738-2b6b-40c3-801b-0f6963c1e559 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:25.938987 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee513738-2b6b-40c3-801b-0f6963c1e559 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:25.939447 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee513738-2b6b-40c3-801b-0f6963c1e559 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:25.939933 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ee513738-2b6b-40c3-801b-0f6963c1e559 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:26.113782 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Flavor limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:06:26.114986 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Image limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:06:26.115476 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Flavor pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:06:26.115896 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Image pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:06:26.117262 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:06:26.131856 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:26.132570 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:26.133279 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:26.134164 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:26.141491 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:26.142161 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:26.166430 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for project 0b789cb75bc24a898888246a7745537e. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:06:26.172881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for user 27653498cd0a4e089f1cbc43470182ee and project 0b789cb75bc24a898888246a7745537e. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:06:26.185592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Going to run 1 instances... {{(pid=120553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:06:26.188806 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:06:26.199858 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ee513738-2b6b-40c3-801b-0f6963c1e559 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:26.210494 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ee513738-2b6b-40c3-801b-0f6963c1e559 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.297067 Sep 01 15:06:26.211775 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 428/857] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:25 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:26.247005 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a7c5535c-305a-4c90-8c26-0edf18fe9b7e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.119072 Sep 01 15:06:26.247650 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 430/858] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:06:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:06:26.258713 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d098a7d2-dd20-4b81-bef7-e4dc47d82490 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:26.259594 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d098a7d2-dd20-4b81-bef7-e4dc47d82490 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:26.336788 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d098a7d2-dd20-4b81-bef7-e4dc47d82490 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:26.348193 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d098a7d2-dd20-4b81-bef7-e4dc47d82490 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1241 microversion: 2.1 time: 0.092398 Sep 01 15:06:26.349630 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 429/859] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:26 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:06:27.233511 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7a17306b-70f1-4332-9a22-0a3edaec9a97 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:27.234907 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7a17306b-70f1-4332-9a22-0a3edaec9a97 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:27.241566 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7a17306b-70f1-4332-9a22-0a3edaec9a97 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:27.242065 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7a17306b-70f1-4332-9a22-0a3edaec9a97 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:27.242563 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7a17306b-70f1-4332-9a22-0a3edaec9a97 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:27.243428 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7a17306b-70f1-4332-9a22-0a3edaec9a97 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:27.244073 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7a17306b-70f1-4332-9a22-0a3edaec9a97 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:27.244502 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7a17306b-70f1-4332-9a22-0a3edaec9a97 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:27.371041 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f5f9760f-5a6d-4206-8c86-065d577323e1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:27.371597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f5f9760f-5a6d-4206-8c86-065d577323e1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:27.388780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5f9760f-5a6d-4206-8c86-065d577323e1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:27.389280 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5f9760f-5a6d-4206-8c86-065d577323e1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:27.389714 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5f9760f-5a6d-4206-8c86-065d577323e1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:27.390624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5f9760f-5a6d-4206-8c86-065d577323e1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:27.390929 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5f9760f-5a6d-4206-8c86-065d577323e1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:27.391354 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f5f9760f-5a6d-4206-8c86-065d577323e1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:27.443710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-7a17306b-70f1-4332-9a22-0a3edaec9a97 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:27.457853 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7a17306b-70f1-4332-9a22-0a3edaec9a97 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.229477 Sep 01 15:06:27.464198 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 431/860] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:27 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:27.559240 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f5f9760f-5a6d-4206-8c86-065d577323e1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:27.569278 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f5f9760f-5a6d-4206-8c86-065d577323e1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1293 microversion: 2.1 time: 0.203967 Sep 01 15:06:27.573903 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 430/861] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:27 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1293 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:28.483245 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-60424491-196f-4eb8-b32b-a33a23dd6f60 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:28.483880 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-60424491-196f-4eb8-b32b-a33a23dd6f60 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:28.493967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-60424491-196f-4eb8-b32b-a33a23dd6f60 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:28.497028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-60424491-196f-4eb8-b32b-a33a23dd6f60 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:28.497513 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-60424491-196f-4eb8-b32b-a33a23dd6f60 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:28.498285 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-60424491-196f-4eb8-b32b-a33a23dd6f60 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:28.500600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-60424491-196f-4eb8-b32b-a33a23dd6f60 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:28.501052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-60424491-196f-4eb8-b32b-a33a23dd6f60 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:28.595386 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-dab59a6c-98a8-4bdf-8d2d-c0849661b5df tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:28.596782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-dab59a6c-98a8-4bdf-8d2d-c0849661b5df tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:28.610403 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dab59a6c-98a8-4bdf-8d2d-c0849661b5df tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:28.610924 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dab59a6c-98a8-4bdf-8d2d-c0849661b5df tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:28.611375 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dab59a6c-98a8-4bdf-8d2d-c0849661b5df tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:28.612126 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dab59a6c-98a8-4bdf-8d2d-c0849661b5df tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:28.612584 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dab59a6c-98a8-4bdf-8d2d-c0849661b5df tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:28.613022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dab59a6c-98a8-4bdf-8d2d-c0849661b5df tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:29.011541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-60424491-196f-4eb8-b32b-a33a23dd6f60 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:29.020449 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-60424491-196f-4eb8-b32b-a33a23dd6f60 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.541570 Sep 01 15:06:29.025300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 432/862] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:28 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:29.036711 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-dab59a6c-98a8-4bdf-8d2d-c0849661b5df tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:29.055144 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-dab59a6c-98a8-4bdf-8d2d-c0849661b5df tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1366 microversion: 2.1 time: 0.463912 Sep 01 15:06:29.074164 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 431/863] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:28 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1366 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:29.655242 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-7e8f9d18-0dee-4765-9709-9aaabff010d4 req-7bacf679-f9ff-49fd-a168-282ddc9711db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b073e711-0ab9-4edf-a2c6-a469c4d32303", "tag": "58e3f0ce-ab70-4aa8-bc68-6a4e59b65dda"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:29.673220 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-7e8f9d18-0dee-4765-9709-9aaabff010d4 req-7bacf679-f9ff-49fd-a168-282ddc9711db service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:29.673957 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-7e8f9d18-0dee-4765-9709-9aaabff010d4 req-7bacf679-f9ff-49fd-a168-282ddc9711db service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:29.674625 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-7e8f9d18-0dee-4765-9709-9aaabff010d4 req-7bacf679-f9ff-49fd-a168-282ddc9711db service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:29.689277 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-7e8f9d18-0dee-4765-9709-9aaabff010d4 req-7bacf679-f9ff-49fd-a168-282ddc9711db service nova] Creating event network-changed:58e3f0ce-ab70-4aa8-bc68-6a4e59b65dda for instance b073e711-0ab9-4edf-a2c6-a469c4d32303 on hv-cinder-85505 Sep 01 15:06:29.694798 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-7e8f9d18-0dee-4765-9709-9aaabff010d4 req-7bacf679-f9ff-49fd-a168-282ddc9711db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046586 Sep 01 15:06:29.696283 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 433/864] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:30.045395 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3ff650a6-92b5-4d84-95b8-6bf7f8f66a5b tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:30.046145 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3ff650a6-92b5-4d84-95b8-6bf7f8f66a5b tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:30.052563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ff650a6-92b5-4d84-95b8-6bf7f8f66a5b tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:30.053057 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ff650a6-92b5-4d84-95b8-6bf7f8f66a5b tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:30.053689 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ff650a6-92b5-4d84-95b8-6bf7f8f66a5b tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:30.054618 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ff650a6-92b5-4d84-95b8-6bf7f8f66a5b tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:30.055268 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ff650a6-92b5-4d84-95b8-6bf7f8f66a5b tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:30.055864 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3ff650a6-92b5-4d84-95b8-6bf7f8f66a5b tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:30.096542 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b44589b0-7ec1-4a1f-b1d2-2486ddfda063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:30.097541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b44589b0-7ec1-4a1f-b1d2-2486ddfda063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:30.104405 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b44589b0-7ec1-4a1f-b1d2-2486ddfda063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:30.104641 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b44589b0-7ec1-4a1f-b1d2-2486ddfda063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:30.104999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b44589b0-7ec1-4a1f-b1d2-2486ddfda063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:30.105718 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b44589b0-7ec1-4a1f-b1d2-2486ddfda063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:30.106183 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b44589b0-7ec1-4a1f-b1d2-2486ddfda063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:30.106663 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b44589b0-7ec1-4a1f-b1d2-2486ddfda063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:30.232722 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3ff650a6-92b5-4d84-95b8-6bf7f8f66a5b tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:30.236513 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:30.243926 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3ff650a6-92b5-4d84-95b8-6bf7f8f66a5b tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.202738 Sep 01 15:06:30.258976 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 432/865] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:30 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:30.268910 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b44589b0-7ec1-4a1f-b1d2-2486ddfda063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:30.276971 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b44589b0-7ec1-4a1f-b1d2-2486ddfda063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1366 microversion: 2.1 time: 0.184542 Sep 01 15:06:30.277527 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 434/866] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:30 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:31.265462 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-155e95b0-8c4b-44f0-b551-f35857dd6a33 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:31.266739 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-155e95b0-8c4b-44f0-b551-f35857dd6a33 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:31.279871 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-155e95b0-8c4b-44f0-b551-f35857dd6a33 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:31.283155 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-155e95b0-8c4b-44f0-b551-f35857dd6a33 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:31.283681 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-155e95b0-8c4b-44f0-b551-f35857dd6a33 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:31.284527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-155e95b0-8c4b-44f0-b551-f35857dd6a33 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:31.285322 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-155e95b0-8c4b-44f0-b551-f35857dd6a33 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:31.285877 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-155e95b0-8c4b-44f0-b551-f35857dd6a33 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:31.297873 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-57cefb21-4cfb-423a-8903-29a0c8c235f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:31.299123 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-57cefb21-4cfb-423a-8903-29a0c8c235f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:31.307301 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57cefb21-4cfb-423a-8903-29a0c8c235f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:31.307806 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57cefb21-4cfb-423a-8903-29a0c8c235f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:31.308246 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57cefb21-4cfb-423a-8903-29a0c8c235f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:31.314014 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57cefb21-4cfb-423a-8903-29a0c8c235f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:31.315125 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57cefb21-4cfb-423a-8903-29a0c8c235f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:31.315900 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57cefb21-4cfb-423a-8903-29a0c8c235f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:31.466792 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-155e95b0-8c4b-44f0-b551-f35857dd6a33 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:31.477001 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-155e95b0-8c4b-44f0-b551-f35857dd6a33 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1569 microversion: 2.1 time: 0.215364 Sep 01 15:06:31.477589 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 433/867] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:31 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:31.499813 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-15c2ba05-5d2a-49e8-b045-eeeb0eb1cbfc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:31.500790 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-15c2ba05-5d2a-49e8-b045-eeeb0eb1cbfc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:31.508040 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-15c2ba05-5d2a-49e8-b045-eeeb0eb1cbfc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:31.508878 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-15c2ba05-5d2a-49e8-b045-eeeb0eb1cbfc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:31.509480 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-15c2ba05-5d2a-49e8-b045-eeeb0eb1cbfc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:31.510459 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-15c2ba05-5d2a-49e8-b045-eeeb0eb1cbfc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:31.511085 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-15c2ba05-5d2a-49e8-b045-eeeb0eb1cbfc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:31.512404 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-15c2ba05-5d2a-49e8-b045-eeeb0eb1cbfc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:31.555430 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-15c2ba05-5d2a-49e8-b045-eeeb0eb1cbfc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120554) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 15:06:31.557765 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-57cefb21-4cfb-423a-8903-29a0c8c235f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:31.573767 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-57cefb21-4cfb-423a-8903-29a0c8c235f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1366 microversion: 2.1 time: 0.279983 Sep 01 15:06:31.574893 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 435/868] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:31 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:06:31.652647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-15c2ba05-5d2a-49e8-b045-eeeb0eb1cbfc tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "POST /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a/action" status: 202 len: 0 microversion: 2.1 time: 0.157814 Sep 01 15:06:31.653915 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 434/869] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:06:31 2022] POST /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 15:06:31.662532 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a067e4a3-e138-48f6-8cbb-c97e3bbf8aa7 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:31.663453 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a067e4a3-e138-48f6-8cbb-c97e3bbf8aa7 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:31.672786 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a067e4a3-e138-48f6-8cbb-c97e3bbf8aa7 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:31.673408 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a067e4a3-e138-48f6-8cbb-c97e3bbf8aa7 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:31.673945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a067e4a3-e138-48f6-8cbb-c97e3bbf8aa7 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:31.674967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a067e4a3-e138-48f6-8cbb-c97e3bbf8aa7 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:31.675499 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a067e4a3-e138-48f6-8cbb-c97e3bbf8aa7 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:31.676142 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a067e4a3-e138-48f6-8cbb-c97e3bbf8aa7 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:31.885510 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a067e4a3-e138-48f6-8cbb-c97e3bbf8aa7 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:31.893532 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a067e4a3-e138-48f6-8cbb-c97e3bbf8aa7 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1577 microversion: 2.1 time: 0.235561 Sep 01 15:06:31.894123 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 436/870] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:31 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:32.597073 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-921e46dd-7681-4834-84f3-97c791aa3616 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:32.598946 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-921e46dd-7681-4834-84f3-97c791aa3616 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:32.606182 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-921e46dd-7681-4834-84f3-97c791aa3616 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:32.606715 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-921e46dd-7681-4834-84f3-97c791aa3616 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:32.607153 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-921e46dd-7681-4834-84f3-97c791aa3616 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:32.607864 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-921e46dd-7681-4834-84f3-97c791aa3616 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:32.608322 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-921e46dd-7681-4834-84f3-97c791aa3616 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:32.608948 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-921e46dd-7681-4834-84f3-97c791aa3616 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:32.782262 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-921e46dd-7681-4834-84f3-97c791aa3616 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:32.791078 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-921e46dd-7681-4834-84f3-97c791aa3616 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1366 microversion: 2.1 time: 0.198578 Sep 01 15:06:32.792116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 435/871] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:32 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:32.918834 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4acb3f48-8c99-47b2-a974-72dbe55da364 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:32.920438 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4acb3f48-8c99-47b2-a974-72dbe55da364 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:32.932478 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4acb3f48-8c99-47b2-a974-72dbe55da364 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:32.933226 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4acb3f48-8c99-47b2-a974-72dbe55da364 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:32.934165 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4acb3f48-8c99-47b2-a974-72dbe55da364 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:32.935128 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4acb3f48-8c99-47b2-a974-72dbe55da364 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:32.935807 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4acb3f48-8c99-47b2-a974-72dbe55da364 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:32.936623 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4acb3f48-8c99-47b2-a974-72dbe55da364 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:33.370613 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4acb3f48-8c99-47b2-a974-72dbe55da364 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:33.380444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4acb3f48-8c99-47b2-a974-72dbe55da364 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1519 microversion: 2.1 time: 0.467468 Sep 01 15:06:33.381989 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 437/872] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:32 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1519 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:33.813638 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-80e404c6-cd8b-46cd-aa6c-5f845ad5865a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:33.814693 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-80e404c6-cd8b-46cd-aa6c-5f845ad5865a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:33.831582 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80e404c6-cd8b-46cd-aa6c-5f845ad5865a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:33.832418 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80e404c6-cd8b-46cd-aa6c-5f845ad5865a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:33.833073 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80e404c6-cd8b-46cd-aa6c-5f845ad5865a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:33.834069 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80e404c6-cd8b-46cd-aa6c-5f845ad5865a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:33.834804 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80e404c6-cd8b-46cd-aa6c-5f845ad5865a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:33.835568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-80e404c6-cd8b-46cd-aa6c-5f845ad5865a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:34.085166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-80e404c6-cd8b-46cd-aa6c-5f845ad5865a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:34.096792 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-80e404c6-cd8b-46cd-aa6c-5f845ad5865a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1366 microversion: 2.1 time: 0.287117 Sep 01 15:06:34.107215 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 436/873] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:33 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:34.415127 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9cdb83c9-343e-4416-9a25-b3461b91fdf8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:34.416463 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9cdb83c9-343e-4416-9a25-b3461b91fdf8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:34.424151 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cdb83c9-343e-4416-9a25-b3461b91fdf8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:34.424721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cdb83c9-343e-4416-9a25-b3461b91fdf8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:34.425238 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cdb83c9-343e-4416-9a25-b3461b91fdf8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:34.426016 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cdb83c9-343e-4416-9a25-b3461b91fdf8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:34.426590 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cdb83c9-343e-4416-9a25-b3461b91fdf8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:34.427078 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9cdb83c9-343e-4416-9a25-b3461b91fdf8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:34.605333 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9cdb83c9-343e-4416-9a25-b3461b91fdf8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:34.614065 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9cdb83c9-343e-4416-9a25-b3461b91fdf8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1575 microversion: 2.1 time: 0.202620 Sep 01 15:06:34.618546 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 438/874] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:34 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:35.120053 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ef637411-f590-4dcd-beca-ffba19fdac17 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:35.121253 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ef637411-f590-4dcd-beca-ffba19fdac17 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:35.128230 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef637411-f590-4dcd-beca-ffba19fdac17 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:35.128721 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef637411-f590-4dcd-beca-ffba19fdac17 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:35.129164 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef637411-f590-4dcd-beca-ffba19fdac17 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:35.129869 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef637411-f590-4dcd-beca-ffba19fdac17 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:35.130355 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef637411-f590-4dcd-beca-ffba19fdac17 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:35.130963 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef637411-f590-4dcd-beca-ffba19fdac17 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:35.288274 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ef637411-f590-4dcd-beca-ffba19fdac17 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:35.299623 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ef637411-f590-4dcd-beca-ffba19fdac17 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1366 microversion: 2.1 time: 0.184031 Sep 01 15:06:35.300782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 437/875] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:35 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:35.436170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-29402191-2fdc-4d32-9e3e-25dcd4a3fb3a req-dffad7c8-c77c-4e42-aa6e-9e13f459571b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a", "name": "network-vif-unplugged", "status": "completed", "tag": "ee2ec77e-7de7-43b9-b302-bffde8d5f382"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:35.448387 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-29402191-2fdc-4d32-9e3e-25dcd4a3fb3a req-dffad7c8-c77c-4e42-aa6e-9e13f459571b service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:35.449233 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-29402191-2fdc-4d32-9e3e-25dcd4a3fb3a req-dffad7c8-c77c-4e42-aa6e-9e13f459571b service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:35.449777 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-29402191-2fdc-4d32-9e3e-25dcd4a3fb3a req-dffad7c8-c77c-4e42-aa6e-9e13f459571b service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:35.475109 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-29402191-2fdc-4d32-9e3e-25dcd4a3fb3a req-dffad7c8-c77c-4e42-aa6e-9e13f459571b service nova] Creating event network-vif-unplugged:ee2ec77e-7de7-43b9-b302-bffde8d5f382 for instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a on hv-cinder-85505 Sep 01 15:06:35.508927 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-29402191-2fdc-4d32-9e3e-25dcd4a3fb3a req-dffad7c8-c77c-4e42-aa6e-9e13f459571b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077542 Sep 01 15:06:35.511410 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 439/876] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:35.639533 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-bd0b0bc7-2755-4175-827a-31b888114d72 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:35.640282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-bd0b0bc7-2755-4175-827a-31b888114d72 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:35.647320 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd0b0bc7-2755-4175-827a-31b888114d72 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:35.648954 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd0b0bc7-2755-4175-827a-31b888114d72 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:35.649635 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd0b0bc7-2755-4175-827a-31b888114d72 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:35.656290 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd0b0bc7-2755-4175-827a-31b888114d72 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:35.657207 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd0b0bc7-2755-4175-827a-31b888114d72 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:35.657883 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd0b0bc7-2755-4175-827a-31b888114d72 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:35.814140 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-bd0b0bc7-2755-4175-827a-31b888114d72 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:35.823092 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-bd0b0bc7-2755-4175-827a-31b888114d72 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1575 microversion: 2.1 time: 0.187884 Sep 01 15:06:35.824010 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 438/877] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:35 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:36.319241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:36.320885 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=6 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:36.326321 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c9448d3e-7f29-4729-b52a-8b92e82e5cc4 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:36.327370 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c9448d3e-7f29-4729-b52a-8b92e82e5cc4 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:36.334051 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:36.339994 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9448d3e-7f29-4729-b52a-8b92e82e5cc4 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:36.340576 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9448d3e-7f29-4729-b52a-8b92e82e5cc4 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:36.341089 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9448d3e-7f29-4729-b52a-8b92e82e5cc4 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:36.341935 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9448d3e-7f29-4729-b52a-8b92e82e5cc4 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:36.342534 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9448d3e-7f29-4729-b52a-8b92e82e5cc4 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:36.343041 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c9448d3e-7f29-4729-b52a-8b92e82e5cc4 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:36.488693 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c9448d3e-7f29-4729-b52a-8b92e82e5cc4 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:36.497098 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c9448d3e-7f29-4729-b52a-8b92e82e5cc4 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1366 microversion: 2.1 time: 0.178792 Sep 01 15:06:36.497771 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 440/878] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:36 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:36.843719 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-847a900c-3a55-4d1c-bf0b-6e39dd80fdef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:36.844954 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-847a900c-3a55-4d1c-bf0b-6e39dd80fdef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:36.847636 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=6 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:36.848491 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:36.853899 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-847a900c-3a55-4d1c-bf0b-6e39dd80fdef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:36.854445 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-847a900c-3a55-4d1c-bf0b-6e39dd80fdef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:36.855067 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-847a900c-3a55-4d1c-bf0b-6e39dd80fdef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:36.855972 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-847a900c-3a55-4d1c-bf0b-6e39dd80fdef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:36.856603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-847a900c-3a55-4d1c-bf0b-6e39dd80fdef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:36.857197 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-847a900c-3a55-4d1c-bf0b-6e39dd80fdef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:37.035839 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-847a900c-3a55-4d1c-bf0b-6e39dd80fdef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:37.044869 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-847a900c-3a55-4d1c-bf0b-6e39dd80fdef tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1575 microversion: 2.1 time: 0.204676 Sep 01 15:06:37.045478 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 439/879] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:36 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:37.529991 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4750c229-0653-4c2c-8e44-62321d868bb8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:37.531254 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4750c229-0653-4c2c-8e44-62321d868bb8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:37.533511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-b21a7922-252a-4ce2-ab61-7ae799ec5f78 req-bf2eeb2e-8195-47ff-8289-c70d46197f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b073e711-0ab9-4edf-a2c6-a469c4d32303", "name": "network-vif-plugged", "status": "completed", "tag": "58e3f0ce-ab70-4aa8-bc68-6a4e59b65dda"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:37.538175 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4750c229-0653-4c2c-8e44-62321d868bb8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:37.538719 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4750c229-0653-4c2c-8e44-62321d868bb8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:37.539156 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4750c229-0653-4c2c-8e44-62321d868bb8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:37.539876 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4750c229-0653-4c2c-8e44-62321d868bb8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:37.540345 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4750c229-0653-4c2c-8e44-62321d868bb8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:37.540782 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4750c229-0653-4c2c-8e44-62321d868bb8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:37.551160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b21a7922-252a-4ce2-ab61-7ae799ec5f78 req-bf2eeb2e-8195-47ff-8289-c70d46197f6e service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:37.551906 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b21a7922-252a-4ce2-ab61-7ae799ec5f78 req-bf2eeb2e-8195-47ff-8289-c70d46197f6e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:37.552521 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b21a7922-252a-4ce2-ab61-7ae799ec5f78 req-bf2eeb2e-8195-47ff-8289-c70d46197f6e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:37.576753 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-b21a7922-252a-4ce2-ab61-7ae799ec5f78 req-bf2eeb2e-8195-47ff-8289-c70d46197f6e service nova] Creating event network-vif-plugged:58e3f0ce-ab70-4aa8-bc68-6a4e59b65dda for instance b073e711-0ab9-4edf-a2c6-a469c4d32303 on hv-cinder-85505 Sep 01 15:06:37.581848 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-b21a7922-252a-4ce2-ab61-7ae799ec5f78 req-bf2eeb2e-8195-47ff-8289-c70d46197f6e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054802 Sep 01 15:06:37.582851 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 440/880] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:06:37.747473 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4750c229-0653-4c2c-8e44-62321d868bb8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:37.756066 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4750c229-0653-4c2c-8e44-62321d868bb8 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1366 microversion: 2.1 time: 0.240533 Sep 01 15:06:37.757981 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 441/881] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:37 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:38.068448 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a25f1403-0dd4-439f-ba96-d364c06520b6 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:38.069470 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a25f1403-0dd4-439f-ba96-d364c06520b6 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:38.076866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a25f1403-0dd4-439f-ba96-d364c06520b6 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:38.077388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a25f1403-0dd4-439f-ba96-d364c06520b6 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:38.077832 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a25f1403-0dd4-439f-ba96-d364c06520b6 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:38.078611 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a25f1403-0dd4-439f-ba96-d364c06520b6 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:38.079095 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a25f1403-0dd4-439f-ba96-d364c06520b6 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:38.079565 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a25f1403-0dd4-439f-ba96-d364c06520b6 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:38.242925 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a25f1403-0dd4-439f-ba96-d364c06520b6 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:38.251678 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a25f1403-0dd4-439f-ba96-d364c06520b6 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1575 microversion: 2.1 time: 0.188406 Sep 01 15:06:38.252364 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 441/882] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:38 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:38.781198 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ae390ca2-3a57-4200-a25d-2f07afe7256c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:38.781719 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c864472a-29a4-4d9d-b423-2f607e545e64 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Action: 'create', calling method: .version_select at 0x7fab73e81790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1161831181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBegVgt39bxhJ7fQ817FE1j2pbKHVGvHUUxqWmZ7EGsNClpaKr8RKHidjzXT3wOYgKTNcehjeBhJ1SWyHfc5MOEz+s1kYHNQ46mwxzydTOfIGxFtIK5T/f36GqQZQ/n2/A=="}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:38.783345 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ae390ca2-3a57-4200-a25d-2f07afe7256c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:38.790055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ae390ca2-3a57-4200-a25d-2f07afe7256c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:38.790579 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ae390ca2-3a57-4200-a25d-2f07afe7256c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:38.791035 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ae390ca2-3a57-4200-a25d-2f07afe7256c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:38.792247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ae390ca2-3a57-4200-a25d-2f07afe7256c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:38.792701 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ae390ca2-3a57-4200-a25d-2f07afe7256c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:38.793131 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ae390ca2-3a57-4200-a25d-2f07afe7256c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:38.799148 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-c864472a-29a4-4d9d-b423-2f607e545e64 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Getting quotas for project a7311840457040a992b3bebaa2d32843. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:06:38.803178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-c864472a-29a4-4d9d-b423-2f607e545e64 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Getting quotas for user 70cd6c18012049419d7fa7b591b4bd28 and project a7311840457040a992b3bebaa2d32843. Resources: {'key_pairs'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:06:38.825665 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c864472a-29a4-4d9d-b423-2f607e545e64 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047942 Sep 01 15:06:38.826493 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 442/883] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 1 15:06:38 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:06:38.877416 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1443299309", "imageRef": "91c544b4-ca0c-49c5-8df1-69e7a11985dc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1161831181", "networks": [{"uuid": "d825e22f-943a-4dbf-8bfa-dbec63f63d97"}]}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:38.930561 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.network.neutron [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] validate_networks() for [('d825e22f-943a-4dbf-8bfa-dbec63f63d97', None, None, None, None, None)] {{(pid=120554) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:06:38.933924 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ae390ca2-3a57-4200-a25d-2f07afe7256c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:38.941849 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ae390ca2-3a57-4200-a25d-2f07afe7256c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1366 microversion: 2.1 time: 0.164881 Sep 01 15:06:38.942541 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 442/884] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:38 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:39.273644 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-12bf82aa-1ebd-4264-9a46-2f61dd37cc68 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:39.275565 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-12bf82aa-1ebd-4264-9a46-2f61dd37cc68 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:39.284045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12bf82aa-1ebd-4264-9a46-2f61dd37cc68 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:39.284992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12bf82aa-1ebd-4264-9a46-2f61dd37cc68 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:39.285673 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12bf82aa-1ebd-4264-9a46-2f61dd37cc68 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:39.286797 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12bf82aa-1ebd-4264-9a46-2f61dd37cc68 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:39.287622 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12bf82aa-1ebd-4264-9a46-2f61dd37cc68 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:39.288375 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-12bf82aa-1ebd-4264-9a46-2f61dd37cc68 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:39.305257 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Flavor limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:06:39.306377 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Image limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:06:39.307144 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Flavor pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:06:39.307889 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Image pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:06:39.308357 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:06:39.318004 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:39.318827 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:39.319342 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:39.319981 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:39.320433 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:39.320895 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:39.340170 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Getting quotas for project a7311840457040a992b3bebaa2d32843. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:06:39.344938 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Getting quotas for user 70cd6c18012049419d7fa7b591b4bd28 and project a7311840457040a992b3bebaa2d32843. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:06:39.358480 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Going to run 1 instances... {{(pid=120554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:06:39.361143 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='91c544b4-ca0c-49c5-8df1-69e7a11985dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:06:39.410375 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-87e0972c-85a7-457d-9952-0bf6ecde439a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536728 Sep 01 15:06:39.411296 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 443/885] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 15:06:39.422665 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1e3b01ad-0281-4183-9c2d-760c7f7a3c42 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:39.423300 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-1e3b01ad-0281-4183-9c2d-760c7f7a3c42 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:39.458462 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-12bf82aa-1ebd-4264-9a46-2f61dd37cc68 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:39.467332 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-12bf82aa-1ebd-4264-9a46-2f61dd37cc68 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1575 microversion: 2.1 time: 0.197634 Sep 01 15:06:39.468001 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 443/886] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:39 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1575 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:06:39.484456 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1e3b01ad-0281-4183-9c2d-760c7f7a3c42 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:39.491540 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-1e3b01ad-0281-4183-9c2d-760c7f7a3c42 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1259 microversion: 2.1 time: 0.073104 Sep 01 15:06:39.492447 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 444/887] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:39 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:06:39.962724 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-57b21800-fbd0-497d-802b-c8ffa750dde7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:39.964075 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-57b21800-fbd0-497d-802b-c8ffa750dde7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:39.970599 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57b21800-fbd0-497d-802b-c8ffa750dde7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:39.971021 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57b21800-fbd0-497d-802b-c8ffa750dde7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:39.971456 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57b21800-fbd0-497d-802b-c8ffa750dde7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:39.972153 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57b21800-fbd0-497d-802b-c8ffa750dde7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:39.972601 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57b21800-fbd0-497d-802b-c8ffa750dde7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:39.973025 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57b21800-fbd0-497d-802b-c8ffa750dde7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:40.106068 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-57b21800-fbd0-497d-802b-c8ffa750dde7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:40.113692 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-57b21800-fbd0-497d-802b-c8ffa750dde7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1556 microversion: 2.1 time: 0.154916 Sep 01 15:06:40.114251 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 444/888] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:39 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:40.133406 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7fdf5b94-8798-409e-ab0a-798fa48ec73a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:40.133899 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7fdf5b94-8798-409e-ab0a-798fa48ec73a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:40.140781 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7fdf5b94-8798-409e-ab0a-798fa48ec73a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:40.141265 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7fdf5b94-8798-409e-ab0a-798fa48ec73a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:40.141699 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7fdf5b94-8798-409e-ab0a-798fa48ec73a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:40.142421 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7fdf5b94-8798-409e-ab0a-798fa48ec73a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:40.142873 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7fdf5b94-8798-409e-ab0a-798fa48ec73a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:40.143542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7fdf5b94-8798-409e-ab0a-798fa48ec73a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:40.229108 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7fdf5b94-8798-409e-ab0a-798fa48ec73a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099496 Sep 01 15:06:40.229701 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 445/889] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 1 15:06:40 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:40.495923 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a0d99a2f-34aa-437a-a7b3-26f747d978ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:40.499779 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a0d99a2f-34aa-437a-a7b3-26f747d978ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:40.514400 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-da245348-716e-4558-bb0d-ab958f413751 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:40.516397 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-da245348-716e-4558-bb0d-ab958f413751 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:40.520128 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a0d99a2f-34aa-437a-a7b3-26f747d978ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:40.529461 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a0d99a2f-34aa-437a-a7b3-26f747d978ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:40.530941 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a0d99a2f-34aa-437a-a7b3-26f747d978ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:40.531879 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a0d99a2f-34aa-437a-a7b3-26f747d978ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:40.532528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a0d99a2f-34aa-437a-a7b3-26f747d978ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:40.533557 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-da245348-716e-4558-bb0d-ab958f413751 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:40.534071 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-da245348-716e-4558-bb0d-ab958f413751 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:40.535036 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a0d99a2f-34aa-437a-a7b3-26f747d978ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:40.538404 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-da245348-716e-4558-bb0d-ab958f413751 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:40.539183 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-da245348-716e-4558-bb0d-ab958f413751 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:40.539657 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-da245348-716e-4558-bb0d-ab958f413751 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:40.540085 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-da245348-716e-4558-bb0d-ab958f413751 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:40.549102 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=100 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:40.743744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a0d99a2f-34aa-437a-a7b3-26f747d978ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:40.753903 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a0d99a2f-34aa-437a-a7b3-26f747d978ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1575 microversion: 2.1 time: 0.267661 Sep 01 15:06:40.754440 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 445/890] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:40 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:40.933564 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-da245348-716e-4558-bb0d-ab958f413751 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:40.942334 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-da245348-716e-4558-bb0d-ab958f413751 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1255 microversion: 2.1 time: 0.433448 Sep 01 15:06:40.946955 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 446/891] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:40 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1255 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:06:41.503849 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-a23214f1-3435-47c5-8724-7709ea793ceb req-fc3c7779-15eb-4b7a-99dc-c95f973304da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b073e711-0ab9-4edf-a2c6-a469c4d32303", "tag": "58e3f0ce-ab70-4aa8-bc68-6a4e59b65dda"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:41.514368 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-a23214f1-3435-47c5-8724-7709ea793ceb req-fc3c7779-15eb-4b7a-99dc-c95f973304da service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:41.514942 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-a23214f1-3435-47c5-8724-7709ea793ceb req-fc3c7779-15eb-4b7a-99dc-c95f973304da service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:41.515384 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-a23214f1-3435-47c5-8724-7709ea793ceb req-fc3c7779-15eb-4b7a-99dc-c95f973304da service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:41.527389 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-a23214f1-3435-47c5-8724-7709ea793ceb req-fc3c7779-15eb-4b7a-99dc-c95f973304da service nova] Creating event network-changed:58e3f0ce-ab70-4aa8-bc68-6a4e59b65dda for instance b073e711-0ab9-4edf-a2c6-a469c4d32303 on hv-cinder-85505 Sep 01 15:06:41.532294 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-a23214f1-3435-47c5-8724-7709ea793ceb req-fc3c7779-15eb-4b7a-99dc-c95f973304da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032139 Sep 01 15:06:41.532878 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 446/892] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:41.779732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-4897f5b4-36c2-4879-8487-fcb655235ac2 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:41.780460 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-4897f5b4-36c2-4879-8487-fcb655235ac2 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:41.787331 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4897f5b4-36c2-4879-8487-fcb655235ac2 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:41.788225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4897f5b4-36c2-4879-8487-fcb655235ac2 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:41.788845 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4897f5b4-36c2-4879-8487-fcb655235ac2 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:41.789728 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4897f5b4-36c2-4879-8487-fcb655235ac2 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:41.790475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4897f5b4-36c2-4879-8487-fcb655235ac2 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:41.791059 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-4897f5b4-36c2-4879-8487-fcb655235ac2 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:41.964665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c151b27d-79b7-4171-8e1c-1b1d392c2a6a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:41.965988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c151b27d-79b7-4171-8e1c-1b1d392c2a6a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:41.972993 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c151b27d-79b7-4171-8e1c-1b1d392c2a6a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:41.974372 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-4897f5b4-36c2-4879-8487-fcb655235ac2 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:41.977116 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c151b27d-79b7-4171-8e1c-1b1d392c2a6a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:41.977778 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c151b27d-79b7-4171-8e1c-1b1d392c2a6a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:41.978872 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c151b27d-79b7-4171-8e1c-1b1d392c2a6a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:41.979577 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c151b27d-79b7-4171-8e1c-1b1d392c2a6a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:41.980362 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c151b27d-79b7-4171-8e1c-1b1d392c2a6a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:41.983923 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-4897f5b4-36c2-4879-8487-fcb655235ac2 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1575 microversion: 2.1 time: 0.211311 Sep 01 15:06:41.984491 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 447/893] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:41 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:42.058083 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c151b27d-79b7-4171-8e1c-1b1d392c2a6a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:42.068342 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c151b27d-79b7-4171-8e1c-1b1d392c2a6a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1311 microversion: 2.1 time: 0.108622 Sep 01 15:06:42.070478 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 447/894] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:41 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:43.005006 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9a6ec5d6-f785-4cb4-89bd-16da10b4711d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:43.005617 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9a6ec5d6-f785-4cb4-89bd-16da10b4711d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:43.015182 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a6ec5d6-f785-4cb4-89bd-16da10b4711d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:43.015678 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a6ec5d6-f785-4cb4-89bd-16da10b4711d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:43.016114 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a6ec5d6-f785-4cb4-89bd-16da10b4711d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:43.016817 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a6ec5d6-f785-4cb4-89bd-16da10b4711d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:43.017321 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a6ec5d6-f785-4cb4-89bd-16da10b4711d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:43.017724 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9a6ec5d6-f785-4cb4-89bd-16da10b4711d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:43.091049 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-09999502-e4c9-47b1-aaaa-278d31c7338c tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:43.091776 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-09999502-e4c9-47b1-aaaa-278d31c7338c tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:43.114395 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-09999502-e4c9-47b1-aaaa-278d31c7338c tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:43.115455 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-09999502-e4c9-47b1-aaaa-278d31c7338c tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:43.116274 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-09999502-e4c9-47b1-aaaa-278d31c7338c tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:43.118600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-09999502-e4c9-47b1-aaaa-278d31c7338c tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:43.119500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-09999502-e4c9-47b1-aaaa-278d31c7338c tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:43.119980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-09999502-e4c9-47b1-aaaa-278d31c7338c tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:43.221898 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-9a6ec5d6-f785-4cb4-89bd-16da10b4711d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:43.230753 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9a6ec5d6-f785-4cb4-89bd-16da10b4711d tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1562 microversion: 2.1 time: 0.229470 Sep 01 15:06:43.237745 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 448/895] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:42 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1562 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:43.276554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-09999502-e4c9-47b1-aaaa-278d31c7338c tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:43.284835 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-09999502-e4c9-47b1-aaaa-278d31c7338c tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1317 microversion: 2.1 time: 0.198386 Sep 01 15:06:43.287568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 448/896] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:43 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:06:44.313500 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-28ead984-610a-48ad-b3af-392519b27727 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:44.314334 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-28ead984-610a-48ad-b3af-392519b27727 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:44.325421 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-28ead984-610a-48ad-b3af-392519b27727 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:44.326705 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-28ead984-610a-48ad-b3af-392519b27727 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:44.327402 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-28ead984-610a-48ad-b3af-392519b27727 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:44.328210 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-28ead984-610a-48ad-b3af-392519b27727 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:44.328891 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-28ead984-610a-48ad-b3af-392519b27727 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:44.329624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-28ead984-610a-48ad-b3af-392519b27727 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:44.493698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-28ead984-610a-48ad-b3af-392519b27727 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:44.507013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-28ead984-610a-48ad-b3af-392519b27727 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.197372 Sep 01 15:06:44.509358 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 449/897] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:44 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:45.437448 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-f8377375-4bfd-4f8e-b982-2438fa2765b8 req-900a8bd6-1ec1-476c-96c8-d25f28cb6e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a", "name": "network-vif-plugged", "status": "completed", "tag": "ee2ec77e-7de7-43b9-b302-bffde8d5f382"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:45.449590 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-f8377375-4bfd-4f8e-b982-2438fa2765b8 req-900a8bd6-1ec1-476c-96c8-d25f28cb6e6c service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:45.450637 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-f8377375-4bfd-4f8e-b982-2438fa2765b8 req-900a8bd6-1ec1-476c-96c8-d25f28cb6e6c service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:45.451411 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-f8377375-4bfd-4f8e-b982-2438fa2765b8 req-900a8bd6-1ec1-476c-96c8-d25f28cb6e6c service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:45.466853 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-f8377375-4bfd-4f8e-b982-2438fa2765b8 req-900a8bd6-1ec1-476c-96c8-d25f28cb6e6c service nova] Creating event network-vif-plugged:ee2ec77e-7de7-43b9-b302-bffde8d5f382 for instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a on hv-cinder-85505 Sep 01 15:06:45.475769 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-f8377375-4bfd-4f8e-b982-2438fa2765b8 req-900a8bd6-1ec1-476c-96c8-d25f28cb6e6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041771 Sep 01 15:06:45.477082 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 449/898] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:45.530224 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-1eb56fc7-6446-4dc7-b893-c3b391e7fc94 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:45.531225 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-1eb56fc7-6446-4dc7-b893-c3b391e7fc94 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:45.538320 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1eb56fc7-6446-4dc7-b893-c3b391e7fc94 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:45.538918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1eb56fc7-6446-4dc7-b893-c3b391e7fc94 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:45.539474 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1eb56fc7-6446-4dc7-b893-c3b391e7fc94 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:45.540250 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1eb56fc7-6446-4dc7-b893-c3b391e7fc94 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:45.540780 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1eb56fc7-6446-4dc7-b893-c3b391e7fc94 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:45.541315 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-1eb56fc7-6446-4dc7-b893-c3b391e7fc94 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:45.689646 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-1eb56fc7-6446-4dc7-b893-c3b391e7fc94 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:45.698815 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-1eb56fc7-6446-4dc7-b893-c3b391e7fc94 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.173327 Sep 01 15:06:45.699647 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 450/899] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:45 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:46.723590 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-85835608-eec0-4813-93ef-4bdd5df4a12d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:46.724299 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-85835608-eec0-4813-93ef-4bdd5df4a12d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:46.731058 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85835608-eec0-4813-93ef-4bdd5df4a12d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:46.731556 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85835608-eec0-4813-93ef-4bdd5df4a12d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:46.732002 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85835608-eec0-4813-93ef-4bdd5df4a12d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:46.734194 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85835608-eec0-4813-93ef-4bdd5df4a12d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:46.734790 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85835608-eec0-4813-93ef-4bdd5df4a12d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:46.735279 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85835608-eec0-4813-93ef-4bdd5df4a12d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:46.884314 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-85835608-eec0-4813-93ef-4bdd5df4a12d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:46.892848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-85835608-eec0-4813-93ef-4bdd5df4a12d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.174011 Sep 01 15:06:46.893413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 450/900] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:46 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:47.916866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d4008ee2-aa67-4f24-872c-9c88bb7b1c61 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:47.917618 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d4008ee2-aa67-4f24-872c-9c88bb7b1c61 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:47.925866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4008ee2-aa67-4f24-872c-9c88bb7b1c61 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:47.926550 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4008ee2-aa67-4f24-872c-9c88bb7b1c61 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:47.927119 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4008ee2-aa67-4f24-872c-9c88bb7b1c61 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:47.928158 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4008ee2-aa67-4f24-872c-9c88bb7b1c61 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:47.928729 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4008ee2-aa67-4f24-872c-9c88bb7b1c61 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:47.929473 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d4008ee2-aa67-4f24-872c-9c88bb7b1c61 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:48.101813 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d4008ee2-aa67-4f24-872c-9c88bb7b1c61 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:48.110333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d4008ee2-aa67-4f24-872c-9c88bb7b1c61 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.198787 Sep 01 15:06:48.110915 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 451/901] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:47 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:49.131410 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d59ad427-ac4c-4484-b59f-cfeb7ee6fc43 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:49.132023 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d59ad427-ac4c-4484-b59f-cfeb7ee6fc43 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:49.138730 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d59ad427-ac4c-4484-b59f-cfeb7ee6fc43 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:49.139214 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d59ad427-ac4c-4484-b59f-cfeb7ee6fc43 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:49.139653 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d59ad427-ac4c-4484-b59f-cfeb7ee6fc43 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:49.140358 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d59ad427-ac4c-4484-b59f-cfeb7ee6fc43 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:49.140819 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d59ad427-ac4c-4484-b59f-cfeb7ee6fc43 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:49.141243 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d59ad427-ac4c-4484-b59f-cfeb7ee6fc43 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:49.289680 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d59ad427-ac4c-4484-b59f-cfeb7ee6fc43 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:49.297662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d59ad427-ac4c-4484-b59f-cfeb7ee6fc43 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.170083 Sep 01 15:06:49.298226 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 451/902] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:49 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:50.320122 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2150dfac-0408-4e6a-bc97-01a6d4ca8b95 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:50.327487 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2150dfac-0408-4e6a-bc97-01a6d4ca8b95 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:50.331023 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:50.332294 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=12 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:50.335952 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2150dfac-0408-4e6a-bc97-01a6d4ca8b95 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:50.336497 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2150dfac-0408-4e6a-bc97-01a6d4ca8b95 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:50.336962 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2150dfac-0408-4e6a-bc97-01a6d4ca8b95 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:50.337654 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2150dfac-0408-4e6a-bc97-01a6d4ca8b95 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:50.338526 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2150dfac-0408-4e6a-bc97-01a6d4ca8b95 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:50.338906 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2150dfac-0408-4e6a-bc97-01a6d4ca8b95 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:50.343510 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:06:50.516911 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2150dfac-0408-4e6a-bc97-01a6d4ca8b95 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:50.524866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2150dfac-0408-4e6a-bc97-01a6d4ca8b95 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.209587 Sep 01 15:06:50.525624 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 452/903] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:50 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:51.546352 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-17d6aaa5-8c6d-4ef9-88dd-c34d3aefc825 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:51.546965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-17d6aaa5-8c6d-4ef9-88dd-c34d3aefc825 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:51.553413 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-17d6aaa5-8c6d-4ef9-88dd-c34d3aefc825 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:51.553899 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-17d6aaa5-8c6d-4ef9-88dd-c34d3aefc825 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:51.554361 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-17d6aaa5-8c6d-4ef9-88dd-c34d3aefc825 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:51.555052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-17d6aaa5-8c6d-4ef9-88dd-c34d3aefc825 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:51.555505 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-17d6aaa5-8c6d-4ef9-88dd-c34d3aefc825 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:51.555928 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-17d6aaa5-8c6d-4ef9-88dd-c34d3aefc825 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:51.819460 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-17d6aaa5-8c6d-4ef9-88dd-c34d3aefc825 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:51.827865 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-17d6aaa5-8c6d-4ef9-88dd-c34d3aefc825 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.285688 Sep 01 15:06:51.828438 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 452/904] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:51 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:52.445729 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-11d81599-50ed-4d99-a922-d0d79c3efa6c req-b55c4d1e-14fb-45e3-a260-503e7b2cc07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bf9afc-7517-4bc5-9f4b-0b9cff1b186c", "tag": "b955ae31-2f13-44ac-bf18-3538dbd1b0ea"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:52.455970 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-11d81599-50ed-4d99-a922-d0d79c3efa6c req-b55c4d1e-14fb-45e3-a260-503e7b2cc07a service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:52.456777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-11d81599-50ed-4d99-a922-d0d79c3efa6c req-b55c4d1e-14fb-45e3-a260-503e7b2cc07a service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:52.457458 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-11d81599-50ed-4d99-a922-d0d79c3efa6c req-b55c4d1e-14fb-45e3-a260-503e7b2cc07a service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:52.470009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-11d81599-50ed-4d99-a922-d0d79c3efa6c req-b55c4d1e-14fb-45e3-a260-503e7b2cc07a service nova] Creating event network-changed:b955ae31-2f13-44ac-bf18-3538dbd1b0ea for instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c on hv-cinder-85505 Sep 01 15:06:52.475199 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-11d81599-50ed-4d99-a922-d0d79c3efa6c req-b55c4d1e-14fb-45e3-a260-503e7b2cc07a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032992 Sep 01 15:06:52.476038 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 453/905] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:52.848497 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-0adcac82-9de0-4524-8f8a-fbda06654975 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:52.849112 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-0adcac82-9de0-4524-8f8a-fbda06654975 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:52.855697 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0adcac82-9de0-4524-8f8a-fbda06654975 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:52.856259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0adcac82-9de0-4524-8f8a-fbda06654975 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:52.856762 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0adcac82-9de0-4524-8f8a-fbda06654975 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:52.857526 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0adcac82-9de0-4524-8f8a-fbda06654975 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:52.858049 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0adcac82-9de0-4524-8f8a-fbda06654975 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:52.858588 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0adcac82-9de0-4524-8f8a-fbda06654975 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:52.993873 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-0adcac82-9de0-4524-8f8a-fbda06654975 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:53.002047 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-0adcac82-9de0-4524-8f8a-fbda06654975 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.157482 Sep 01 15:06:53.002640 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 453/906] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:52 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:54.024361 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-98fcf0b7-ae65-44bf-928b-daf1fa4a524f tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:54.025122 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-98fcf0b7-ae65-44bf-928b-daf1fa4a524f tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:54.031759 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-98fcf0b7-ae65-44bf-928b-daf1fa4a524f tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:54.032247 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-98fcf0b7-ae65-44bf-928b-daf1fa4a524f tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:54.032680 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-98fcf0b7-ae65-44bf-928b-daf1fa4a524f tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:54.033375 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-98fcf0b7-ae65-44bf-928b-daf1fa4a524f tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:54.033831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-98fcf0b7-ae65-44bf-928b-daf1fa4a524f tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:54.034273 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-98fcf0b7-ae65-44bf-928b-daf1fa4a524f tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:54.163967 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-98fcf0b7-ae65-44bf-928b-daf1fa4a524f tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:54.172233 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-98fcf0b7-ae65-44bf-928b-daf1fa4a524f tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.152676 Sep 01 15:06:54.172808 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 454/907] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:54 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:55.193654 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5abfd696-1cf1-4c88-bed5-941a564a23bd tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:55.194326 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5abfd696-1cf1-4c88-bed5-941a564a23bd tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:55.200691 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5abfd696-1cf1-4c88-bed5-941a564a23bd tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:55.201169 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5abfd696-1cf1-4c88-bed5-941a564a23bd tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:55.201604 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5abfd696-1cf1-4c88-bed5-941a564a23bd tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:55.202319 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5abfd696-1cf1-4c88-bed5-941a564a23bd tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:55.202773 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5abfd696-1cf1-4c88-bed5-941a564a23bd tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:55.203196 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5abfd696-1cf1-4c88-bed5-941a564a23bd tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:55.334063 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-5abfd696-1cf1-4c88-bed5-941a564a23bd tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:55.342380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5abfd696-1cf1-4c88-bed5-941a564a23bd tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.152494 Sep 01 15:06:55.342947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 454/908] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:55 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:56.363213 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-fadd603d-e5dd-4338-a4dd-5ccc892e5a5b tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:56.363806 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-fadd603d-e5dd-4338-a4dd-5ccc892e5a5b tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:56.371059 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fadd603d-e5dd-4338-a4dd-5ccc892e5a5b tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:56.371547 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fadd603d-e5dd-4338-a4dd-5ccc892e5a5b tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:56.371988 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fadd603d-e5dd-4338-a4dd-5ccc892e5a5b tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:56.372689 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fadd603d-e5dd-4338-a4dd-5ccc892e5a5b tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:56.373147 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fadd603d-e5dd-4338-a4dd-5ccc892e5a5b tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:56.373574 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fadd603d-e5dd-4338-a4dd-5ccc892e5a5b tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:56.507895 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-fadd603d-e5dd-4338-a4dd-5ccc892e5a5b tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:56.515747 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-fadd603d-e5dd-4338-a4dd-5ccc892e5a5b tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.156354 Sep 01 15:06:56.516311 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 455/909] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:56 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:57.492217 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-b9ca44fa-626c-41f8-aa92-4f0080df6f11 req-a9b89842-3872-4dac-b8c6-65ab511ae877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bf9afc-7517-4bc5-9f4b-0b9cff1b186c", "name": "network-vif-plugged", "status": "completed", "tag": "b955ae31-2f13-44ac-bf18-3538dbd1b0ea"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:06:57.503319 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-b9ca44fa-626c-41f8-aa92-4f0080df6f11 req-a9b89842-3872-4dac-b8c6-65ab511ae877 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:57.503806 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-b9ca44fa-626c-41f8-aa92-4f0080df6f11 req-a9b89842-3872-4dac-b8c6-65ab511ae877 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:57.504320 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-b9ca44fa-626c-41f8-aa92-4f0080df6f11 req-a9b89842-3872-4dac-b8c6-65ab511ae877 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:57.516625 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-b9ca44fa-626c-41f8-aa92-4f0080df6f11 req-a9b89842-3872-4dac-b8c6-65ab511ae877 service nova] Creating event network-vif-plugged:b955ae31-2f13-44ac-bf18-3538dbd1b0ea for instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c on hv-cinder-85505 Sep 01 15:06:57.521658 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-b9ca44fa-626c-41f8-aa92-4f0080df6f11 req-a9b89842-3872-4dac-b8c6-65ab511ae877 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033220 Sep 01 15:06:57.522600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 455/910] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:06:57.538782 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-bd79cff1-a3d7-4c3d-bf54-41b4c93346d3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:57.539411 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-bd79cff1-a3d7-4c3d-bf54-41b4c93346d3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:57.548639 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd79cff1-a3d7-4c3d-bf54-41b4c93346d3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:57.549238 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd79cff1-a3d7-4c3d-bf54-41b4c93346d3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:57.549677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd79cff1-a3d7-4c3d-bf54-41b4c93346d3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:57.550646 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd79cff1-a3d7-4c3d-bf54-41b4c93346d3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:57.551103 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd79cff1-a3d7-4c3d-bf54-41b4c93346d3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:57.551717 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bd79cff1-a3d7-4c3d-bf54-41b4c93346d3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:57.691309 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-bd79cff1-a3d7-4c3d-bf54-41b4c93346d3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:57.699657 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-bd79cff1-a3d7-4c3d-bf54-41b4c93346d3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.166656 Sep 01 15:06:57.700267 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 456/911] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:57 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:58.721563 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-cee59ad2-2b37-424e-8632-3e8be3a7b0be tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:58.722383 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-cee59ad2-2b37-424e-8632-3e8be3a7b0be tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:58.729763 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cee59ad2-2b37-424e-8632-3e8be3a7b0be tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:58.730279 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cee59ad2-2b37-424e-8632-3e8be3a7b0be tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:58.730732 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cee59ad2-2b37-424e-8632-3e8be3a7b0be tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:58.731440 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cee59ad2-2b37-424e-8632-3e8be3a7b0be tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:58.731903 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cee59ad2-2b37-424e-8632-3e8be3a7b0be tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:58.732363 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-cee59ad2-2b37-424e-8632-3e8be3a7b0be tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:58.865234 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-cee59ad2-2b37-424e-8632-3e8be3a7b0be tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:06:58.873543 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-cee59ad2-2b37-424e-8632-3e8be3a7b0be tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1359 microversion: 2.1 time: 0.156626 Sep 01 15:06:58.874100 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 456/912] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:58 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:06:59.895051 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-213723c3-6a88-44a0-afb4-0d7107e7fb1e tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:06:59.895670 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-213723c3-6a88-44a0-afb4-0d7107e7fb1e tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:06:59.902694 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-213723c3-6a88-44a0-afb4-0d7107e7fb1e tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:59.903183 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-213723c3-6a88-44a0-afb4-0d7107e7fb1e tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:59.903623 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-213723c3-6a88-44a0-afb4-0d7107e7fb1e tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:06:59.904320 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-213723c3-6a88-44a0-afb4-0d7107e7fb1e tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:06:59.904778 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-213723c3-6a88-44a0-afb4-0d7107e7fb1e tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:06:59.905210 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-213723c3-6a88-44a0-afb4-0d7107e7fb1e tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:00.036734 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-213723c3-6a88-44a0-afb4-0d7107e7fb1e tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:00.045022 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-213723c3-6a88-44a0-afb4-0d7107e7fb1e tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1548 microversion: 2.1 time: 0.153847 Sep 01 15:07:00.045599 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 457/913] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:06:59 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:00.064618 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c961cf1a-5bfe-4661-80c7-7daa536cfb76 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:00.065230 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c961cf1a-5bfe-4661-80c7-7daa536cfb76 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:00.071625 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c961cf1a-5bfe-4661-80c7-7daa536cfb76 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:00.072605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c961cf1a-5bfe-4661-80c7-7daa536cfb76 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:00.073039 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c961cf1a-5bfe-4661-80c7-7daa536cfb76 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:00.073822 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c961cf1a-5bfe-4661-80c7-7daa536cfb76 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:00.074303 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c961cf1a-5bfe-4661-80c7-7daa536cfb76 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:00.074726 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c961cf1a-5bfe-4661-80c7-7daa536cfb76 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:00.210391 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c961cf1a-5bfe-4661-80c7-7daa536cfb76 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:00.219074 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c961cf1a-5bfe-4661-80c7-7daa536cfb76 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1548 microversion: 2.1 time: 0.158202 Sep 01 15:07:00.219634 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 457/914] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:00 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:00.238502 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d64f26be-087b-4967-b867-7709749b4b05 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:00.243296 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d64f26be-087b-4967-b867-7709749b4b05 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:00.244102 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d64f26be-087b-4967-b867-7709749b4b05 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Searching by: {'deleted': False, 'project_id': 'a7311840457040a992b3bebaa2d32843'} {{(pid=120554) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 15:07:00.250698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d64f26be-087b-4967-b867-7709749b4b05 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:00.251179 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d64f26be-087b-4967-b867-7709749b4b05 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:00.251614 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d64f26be-087b-4967-b867-7709749b4b05 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:00.252340 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d64f26be-087b-4967-b867-7709749b4b05 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:00.252798 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d64f26be-087b-4967-b867-7709749b4b05 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:00.253227 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d64f26be-087b-4967-b867-7709749b4b05 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:00.347354 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.multi_cell_list [None req-d64f26be-087b-4967-b867-7709749b4b05 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120554) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 15:07:00.441959 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d64f26be-087b-4967-b867-7709749b4b05 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207290 Sep 01 15:07:00.442575 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 458/915] 10.222.0.33 () {58 vars in 1125 bytes} [Thu Sep 1 15:07:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:00.454391 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-932ad2ed-8498-43e4-81d0-e27dce4d5e69 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:00.455008 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-932ad2ed-8498-43e4-81d0-e27dce4d5e69 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:00.464705 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-932ad2ed-8498-43e4-81d0-e27dce4d5e69 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:00.465194 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-932ad2ed-8498-43e4-81d0-e27dce4d5e69 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:00.465633 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-932ad2ed-8498-43e4-81d0-e27dce4d5e69 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:00.466420 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-932ad2ed-8498-43e4-81d0-e27dce4d5e69 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:00.466878 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-932ad2ed-8498-43e4-81d0-e27dce4d5e69 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:00.467302 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-932ad2ed-8498-43e4-81d0-e27dce4d5e69 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:00.594392 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-932ad2ed-8498-43e4-81d0-e27dce4d5e69 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:00.602104 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-932ad2ed-8498-43e4-81d0-e27dce4d5e69 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1548 microversion: 2.1 time: 0.151668 Sep 01 15:07:00.602696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 458/916] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:00 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:02.137885 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-b208a6a1-a3df-4422-a7cf-4287075d7d30 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ee87cc3-c7ca-44a8-a7b6-62206662d949"}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:02.140218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-b208a6a1-a3df-4422-a7cf-4287075d7d30 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:02.146763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b208a6a1-a3df-4422-a7cf-4287075d7d30 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:02.147252 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b208a6a1-a3df-4422-a7cf-4287075d7d30 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:02.147695 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b208a6a1-a3df-4422-a7cf-4287075d7d30 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:02.148390 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b208a6a1-a3df-4422-a7cf-4287075d7d30 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:02.148852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b208a6a1-a3df-4422-a7cf-4287075d7d30 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:02.149283 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-b208a6a1-a3df-4422-a7cf-4287075d7d30 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:02.407231 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-b208a6a1-a3df-4422-a7cf-4287075d7d30 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "POST /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273314 Sep 01 15:07:02.407861 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 459/917] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:07:02 2022] POST /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:09.982490 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2d299ba2-3415-48c7-8bbb-38e1d58237b9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:09.983300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2d299ba2-3415-48c7-8bbb-38e1d58237b9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:09.986118 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=38 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:09.992249 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d299ba2-3415-48c7-8bbb-38e1d58237b9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:09.992802 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d299ba2-3415-48c7-8bbb-38e1d58237b9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:09.993258 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d299ba2-3415-48c7-8bbb-38e1d58237b9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:09.993995 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d299ba2-3415-48c7-8bbb-38e1d58237b9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:09.994607 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d299ba2-3415-48c7-8bbb-38e1d58237b9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:09.995604 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d299ba2-3415-48c7-8bbb-38e1d58237b9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:10.379509 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2d299ba2-3415-48c7-8bbb-38e1d58237b9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:10.388304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2d299ba2-3415-48c7-8bbb-38e1d58237b9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1594 microversion: 2.1 time: 0.411164 Sep 01 15:07:10.388855 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 459/918] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:09 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1594 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:12.060016 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:12.067405 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-b5ba36fd-f499-4b62-8e53-119b060020d0 req-b16dbdca-7c17-4262-ae49-63e9b52b6872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bf9afc-7517-4bc5-9f4b-0b9cff1b186c", "tag": "b955ae31-2f13-44ac-bf18-3538dbd1b0ea"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:12.078302 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:12.087314 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b5ba36fd-f499-4b62-8e53-119b060020d0 req-b16dbdca-7c17-4262-ae49-63e9b52b6872 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:12.087795 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b5ba36fd-f499-4b62-8e53-119b060020d0 req-b16dbdca-7c17-4262-ae49-63e9b52b6872 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:12.088254 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b5ba36fd-f499-4b62-8e53-119b060020d0 req-b16dbdca-7c17-4262-ae49-63e9b52b6872 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:12.101812 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-b5ba36fd-f499-4b62-8e53-119b060020d0 req-b16dbdca-7c17-4262-ae49-63e9b52b6872 service nova] Creating event network-changed:b955ae31-2f13-44ac-bf18-3538dbd1b0ea for instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c on hv-cinder-85505 Sep 01 15:07:12.107870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-b5ba36fd-f499-4b62-8e53-119b060020d0 req-b16dbdca-7c17-4262-ae49-63e9b52b6872 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049135 Sep 01 15:07:12.108683 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 460/919] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:13.114436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-68a598ee-9671-4263-bcb4-8a51553b9556 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1294547924"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:13.115523 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-68a598ee-9671-4263-bcb4-8a51553b9556 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:13.124619 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-68a598ee-9671-4263-bcb4-8a51553b9556 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:13.125110 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-68a598ee-9671-4263-bcb4-8a51553b9556 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:13.125546 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-68a598ee-9671-4263-bcb4-8a51553b9556 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:13.126298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-68a598ee-9671-4263-bcb4-8a51553b9556 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:13.126754 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-68a598ee-9671-4263-bcb4-8a51553b9556 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:13.127177 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-68a598ee-9671-4263-bcb4-8a51553b9556 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:13.129634 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=77 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:13.258852 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.network.security_group_api [None req-68a598ee-9671-4263-bcb4-8a51553b9556 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Adding security group 297e84e3-c75d-4368-96fe-4f1f18ae126a to port b955ae31-2f13-44ac-bf18-3538dbd1b0ea Sep 01 15:07:13.576589 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-68a598ee-9671-4263-bcb4-8a51553b9556 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "POST /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/action" status: 202 len: 0 microversion: 2.1 time: 0.466010 Sep 01 15:07:13.577629 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 460/920] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:07:13 2022] POST /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:07:13.585715 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e668a71d-d2ff-4512-8e99-505ffdee96a0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:13.586444 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e668a71d-d2ff-4512-8e99-505ffdee96a0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:13.593783 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e668a71d-d2ff-4512-8e99-505ffdee96a0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:13.594286 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e668a71d-d2ff-4512-8e99-505ffdee96a0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:13.594724 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e668a71d-d2ff-4512-8e99-505ffdee96a0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:13.595614 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e668a71d-d2ff-4512-8e99-505ffdee96a0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:13.596071 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e668a71d-d2ff-4512-8e99-505ffdee96a0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:13.596498 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e668a71d-d2ff-4512-8e99-505ffdee96a0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:13.741329 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e668a71d-d2ff-4512-8e99-505ffdee96a0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:13.750482 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e668a71d-d2ff-4512-8e99-505ffdee96a0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1760 microversion: 2.1 time: 0.168854 Sep 01 15:07:13.751144 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 461/921] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:13 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:14.122433 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-2e2d8ef9-aac9-46e1-8bc6-744426a88bd7 req-f9cc954c-deb9-4bb9-9c65-379b28716e81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bf9afc-7517-4bc5-9f4b-0b9cff1b186c", "tag": "b955ae31-2f13-44ac-bf18-3538dbd1b0ea"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:14.132862 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-2e2d8ef9-aac9-46e1-8bc6-744426a88bd7 req-f9cc954c-deb9-4bb9-9c65-379b28716e81 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:14.133459 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-2e2d8ef9-aac9-46e1-8bc6-744426a88bd7 req-f9cc954c-deb9-4bb9-9c65-379b28716e81 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:14.133890 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-2e2d8ef9-aac9-46e1-8bc6-744426a88bd7 req-f9cc954c-deb9-4bb9-9c65-379b28716e81 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:14.145185 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-2e2d8ef9-aac9-46e1-8bc6-744426a88bd7 req-f9cc954c-deb9-4bb9-9c65-379b28716e81 service nova] Creating event network-changed:b955ae31-2f13-44ac-bf18-3538dbd1b0ea for instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c on hv-cinder-85505 Sep 01 15:07:14.149950 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-2e2d8ef9-aac9-46e1-8bc6-744426a88bd7 req-f9cc954c-deb9-4bb9-9c65-379b28716e81 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031367 Sep 01 15:07:14.151635 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 461/922] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:25.348930 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-abfbca32-5199-4d7f-a1ca-bafddbc28456 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:25.349599 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-abfbca32-5199-4d7f-a1ca-bafddbc28456 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:25.352277 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:25.353004 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:25.359912 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abfbca32-5199-4d7f-a1ca-bafddbc28456 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:25.360429 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abfbca32-5199-4d7f-a1ca-bafddbc28456 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:25.360866 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abfbca32-5199-4d7f-a1ca-bafddbc28456 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:25.361558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abfbca32-5199-4d7f-a1ca-bafddbc28456 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:25.362012 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abfbca32-5199-4d7f-a1ca-bafddbc28456 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:25.362476 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-abfbca32-5199-4d7f-a1ca-bafddbc28456 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:25.388605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-abfbca32-5199-4d7f-a1ca-bafddbc28456 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/ips" status: 200 len: 150 microversion: 2.1 time: 0.043914 Sep 01 15:07:25.389165 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 462/923] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 1 15:07:25 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:26.744104 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=5 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:26.744844 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=5 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:26.749782 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-fa693d40-d7dc-4ef2-80fb-20ae6602a331 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:26.752188 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-fa693d40-d7dc-4ef2-80fb-20ae6602a331 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:26.759180 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fa693d40-d7dc-4ef2-80fb-20ae6602a331 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:26.759662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fa693d40-d7dc-4ef2-80fb-20ae6602a331 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:26.760128 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fa693d40-d7dc-4ef2-80fb-20ae6602a331 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:26.760820 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fa693d40-d7dc-4ef2-80fb-20ae6602a331 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:26.761278 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fa693d40-d7dc-4ef2-80fb-20ae6602a331 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:26.761706 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fa693d40-d7dc-4ef2-80fb-20ae6602a331 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:27.004906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-fa693d40-d7dc-4ef2-80fb-20ae6602a331 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262134 Sep 01 15:07:27.005855 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 462/924] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:07:26 2022] POST /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:33.491576 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d"}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:33.494111 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:33.501830 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:33.502474 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:33.502985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:33.503800 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:33.504350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:33.504983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:33.592948 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Invalid volume: volume 7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d is already attached to instances: b073e711-0ab9-4edf-a2c6-a469c4d32303 Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: POST /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-volume_attachments HTTP/1.1 Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 74 Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:07:33.595234 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {"volumeAttachment": {"volumeId": "7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d"}} Sep 01 15:07:33.596993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Invalid volume: volume 7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d is already attached to instances: b073e711-0ab9-4edf-a2c6-a469c4d32303 Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'server_id': 'b073e711-0ab9-4edf-a2c6-a469c4d32303', 'body': {'volumeAttachment': {'volumeId': '7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d'}}} Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d is already attached to instances: b073e711-0ab9-4edf-a2c6-a469c4d32303 Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:07:33.597983 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d is already attached to instances: b073e711-0ab9-4edf-a2c6-a469c4d32303 Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:07:33.599738 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:07:33.601287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:07:33.601287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:07:33.601287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:07:33.601287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d is already attached to instances: b073e711-0ab9-4edf-a2c6-a469c4d32303 Sep 01 15:07:33.601287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:07:33.601287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 400 to user: Invalid volume: volume 7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d is already attached to instances: b073e711-0ab9-4edf-a2c6-a469c4d32303 {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:07:33.601287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5292bab2-cbcc-41b1-82e4-0f45e3df7692 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110374 Sep 01 15:07:33.601287 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 463/925] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:07:33 2022] POST /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 15:07:33.669073 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-540664a7-7017-4f72-994d-8b02982ff285 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:33.669656 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-540664a7-7017-4f72-994d-8b02982ff285 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:33.677487 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-540664a7-7017-4f72-994d-8b02982ff285 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:33.677974 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-540664a7-7017-4f72-994d-8b02982ff285 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:33.678457 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-540664a7-7017-4f72-994d-8b02982ff285 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:33.679156 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-540664a7-7017-4f72-994d-8b02982ff285 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:33.679610 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-540664a7-7017-4f72-994d-8b02982ff285 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:33.680035 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-540664a7-7017-4f72-994d-8b02982ff285 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:33.759360 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-540664a7-7017-4f72-994d-8b02982ff285 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lazy-loading 'services' on Instance uuid b073e711-0ab9-4edf-a2c6-a469c4d32303 {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:07:33.831875 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-540664a7-7017-4f72-994d-8b02982ff285 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-volume_attachments/7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d" status: 202 len: 0 microversion: 2.1 time: 0.167623 Sep 01 15:07:33.832587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 463/926] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:07:33 2022] DELETE /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-volume_attachments/7db6c1d7-57d6-48b1-a3c0-c44fd0e51c6d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:07:33.841390 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f879b753-1276-40b9-ab0d-57d86c0f9710 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:33.844364 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f879b753-1276-40b9-ab0d-57d86c0f9710 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:33.851160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f879b753-1276-40b9-ab0d-57d86c0f9710 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:33.851655 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f879b753-1276-40b9-ab0d-57d86c0f9710 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:33.852135 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f879b753-1276-40b9-ab0d-57d86c0f9710 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:33.852981 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f879b753-1276-40b9-ab0d-57d86c0f9710 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:33.853316 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f879b753-1276-40b9-ab0d-57d86c0f9710 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:33.853750 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f879b753-1276-40b9-ab0d-57d86c0f9710 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:33.886499 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f879b753-1276-40b9-ab0d-57d86c0f9710 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048990 Sep 01 15:07:33.887091 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 464/927] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:07:33 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:34.899810 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-73e56f04-f312-4ee0-b919-24d3360ac256 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:34.902172 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-73e56f04-f312-4ee0-b919-24d3360ac256 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:34.909362 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-73e56f04-f312-4ee0-b919-24d3360ac256 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:34.909848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-73e56f04-f312-4ee0-b919-24d3360ac256 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:34.910309 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-73e56f04-f312-4ee0-b919-24d3360ac256 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:34.911002 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-73e56f04-f312-4ee0-b919-24d3360ac256 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:34.911461 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-73e56f04-f312-4ee0-b919-24d3360ac256 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:34.911888 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-73e56f04-f312-4ee0-b919-24d3360ac256 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:34.941318 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-73e56f04-f312-4ee0-b919-24d3360ac256 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045868 Sep 01 15:07:34.941791 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 464/928] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:07:34 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 15:07:35.011598 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-9c55520f-289e-4c6a-848e-c0881ab3fc64 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:35.012358 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9c55520f-289e-4c6a-848e-c0881ab3fc64 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:35.018589 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c55520f-289e-4c6a-848e-c0881ab3fc64 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:35.019073 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c55520f-289e-4c6a-848e-c0881ab3fc64 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:35.019508 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c55520f-289e-4c6a-848e-c0881ab3fc64 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:35.020200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c55520f-289e-4c6a-848e-c0881ab3fc64 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:35.020653 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c55520f-289e-4c6a-848e-c0881ab3fc64 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:35.021070 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-9c55520f-289e-4c6a-848e-c0881ab3fc64 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:35.047750 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-9c55520f-289e-4c6a-848e-c0881ab3fc64 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:07:35.126515 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-9c55520f-289e-4c6a-848e-c0881ab3fc64 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 204 len: 0 microversion: 2.1 time: 0.118521 Sep 01 15:07:35.127212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 465/929] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:07:35 2022] DELETE /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:07:35.135958 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-5929140b-da1e-4168-9db7-edf18b01a203 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:35.136598 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-5929140b-da1e-4168-9db7-edf18b01a203 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:35.143462 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5929140b-da1e-4168-9db7-edf18b01a203 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:35.143947 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5929140b-da1e-4168-9db7-edf18b01a203 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:35.144380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5929140b-da1e-4168-9db7-edf18b01a203 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:35.145075 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5929140b-da1e-4168-9db7-edf18b01a203 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:35.145527 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5929140b-da1e-4168-9db7-edf18b01a203 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:35.145952 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-5929140b-da1e-4168-9db7-edf18b01a203 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:35.285021 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-5929140b-da1e-4168-9db7-edf18b01a203 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:35.292857 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-5929140b-da1e-4168-9db7-edf18b01a203 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1681 microversion: 2.1 time: 0.161039 Sep 01 15:07:35.293687 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 465/930] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:35 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:36.315596 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2cd79f37-c206-4512-844c-22f9af47c7d1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:36.316345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2cd79f37-c206-4512-844c-22f9af47c7d1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:36.322871 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cd79f37-c206-4512-844c-22f9af47c7d1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:36.323359 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cd79f37-c206-4512-844c-22f9af47c7d1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:36.323796 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cd79f37-c206-4512-844c-22f9af47c7d1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:36.324493 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cd79f37-c206-4512-844c-22f9af47c7d1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:36.324952 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cd79f37-c206-4512-844c-22f9af47c7d1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:36.325382 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2cd79f37-c206-4512-844c-22f9af47c7d1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:36.468447 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2cd79f37-c206-4512-844c-22f9af47c7d1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:36.476333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2cd79f37-c206-4512-844c-22f9af47c7d1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1681 microversion: 2.1 time: 0.164951 Sep 01 15:07:36.476895 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 466/931] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:36 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:37.071246 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-85d9a8fd-119a-4e24-b42f-0fadeef612c9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:37.073568 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-85d9a8fd-119a-4e24-b42f-0fadeef612c9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:37.080767 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85d9a8fd-119a-4e24-b42f-0fadeef612c9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:37.081247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85d9a8fd-119a-4e24-b42f-0fadeef612c9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:37.081686 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85d9a8fd-119a-4e24-b42f-0fadeef612c9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:37.082436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85d9a8fd-119a-4e24-b42f-0fadeef612c9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:37.082894 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85d9a8fd-119a-4e24-b42f-0fadeef612c9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:37.083320 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-85d9a8fd-119a-4e24-b42f-0fadeef612c9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:37.154538 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-85d9a8fd-119a-4e24-b42f-0fadeef612c9 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "POST /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/action" status: 202 len: 0 microversion: 2.1 time: 0.086954 Sep 01 15:07:37.155157 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 466/932] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:07:37 2022] POST /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:07:37.163281 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-73ffd791-cd6b-4819-9e5d-b027c970d299 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:37.163908 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-73ffd791-cd6b-4819-9e5d-b027c970d299 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:37.170511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73ffd791-cd6b-4819-9e5d-b027c970d299 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:37.171111 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73ffd791-cd6b-4819-9e5d-b027c970d299 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:37.171675 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73ffd791-cd6b-4819-9e5d-b027c970d299 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:37.172495 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73ffd791-cd6b-4819-9e5d-b027c970d299 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:37.173059 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73ffd791-cd6b-4819-9e5d-b027c970d299 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:37.173527 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73ffd791-cd6b-4819-9e5d-b027c970d299 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:37.316948 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-73ffd791-cd6b-4819-9e5d-b027c970d299 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:37.325356 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-73ffd791-cd6b-4819-9e5d-b027c970d299 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1752 microversion: 2.1 time: 0.165887 Sep 01 15:07:37.325920 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 467/933] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:37 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:37.499315 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-9708685d-3951-416f-83b1-81de4ef7284a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:37.500046 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-9708685d-3951-416f-83b1-81de4ef7284a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:37.506212 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9708685d-3951-416f-83b1-81de4ef7284a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:37.506737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9708685d-3951-416f-83b1-81de4ef7284a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:37.507175 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9708685d-3951-416f-83b1-81de4ef7284a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:37.507899 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9708685d-3951-416f-83b1-81de4ef7284a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:37.508355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9708685d-3951-416f-83b1-81de4ef7284a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:37.508781 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-9708685d-3951-416f-83b1-81de4ef7284a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:37.639897 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-9708685d-3951-416f-83b1-81de4ef7284a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:37.647679 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-9708685d-3951-416f-83b1-81de4ef7284a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1681 microversion: 2.1 time: 0.153162 Sep 01 15:07:37.648235 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 467/934] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:37 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:07:38.347691 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-09a35255-e123-4564-98a6-66228d91d729 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:38.348939 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-09a35255-e123-4564-98a6-66228d91d729 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:38.356677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-09a35255-e123-4564-98a6-66228d91d729 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:38.356677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-09a35255-e123-4564-98a6-66228d91d729 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:38.356677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-09a35255-e123-4564-98a6-66228d91d729 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:38.357291 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-09a35255-e123-4564-98a6-66228d91d729 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:38.357754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-09a35255-e123-4564-98a6-66228d91d729 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:38.358181 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-09a35255-e123-4564-98a6-66228d91d729 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:38.501389 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-09a35255-e123-4564-98a6-66228d91d729 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:38.509588 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-09a35255-e123-4564-98a6-66228d91d729 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1752 microversion: 2.1 time: 0.165784 Sep 01 15:07:38.510181 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 468/935] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:38 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:38.670042 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-83034566-61c3-4b61-9945-356067fd8799 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:38.670707 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-83034566-61c3-4b61-9945-356067fd8799 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:38.677147 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83034566-61c3-4b61-9945-356067fd8799 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:38.677624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83034566-61c3-4b61-9945-356067fd8799 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:38.678056 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83034566-61c3-4b61-9945-356067fd8799 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:38.678762 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83034566-61c3-4b61-9945-356067fd8799 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:38.679215 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83034566-61c3-4b61-9945-356067fd8799 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:38.679636 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-83034566-61c3-4b61-9945-356067fd8799 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:38.806496 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-83034566-61c3-4b61-9945-356067fd8799 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:38.814867 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-83034566-61c3-4b61-9945-356067fd8799 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1681 microversion: 2.1 time: 0.149387 Sep 01 15:07:38.815476 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 468/936] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:38 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:39.532218 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-db8fb532-4e8c-421e-aff1-389e41c2dc2d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:39.532963 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-db8fb532-4e8c-421e-aff1-389e41c2dc2d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:39.540317 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db8fb532-4e8c-421e-aff1-389e41c2dc2d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:39.540815 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db8fb532-4e8c-421e-aff1-389e41c2dc2d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:39.541317 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db8fb532-4e8c-421e-aff1-389e41c2dc2d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:39.542030 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db8fb532-4e8c-421e-aff1-389e41c2dc2d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:39.542561 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db8fb532-4e8c-421e-aff1-389e41c2dc2d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:39.542992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-db8fb532-4e8c-421e-aff1-389e41c2dc2d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:39.716180 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-db8fb532-4e8c-421e-aff1-389e41c2dc2d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:39.726015 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-db8fb532-4e8c-421e-aff1-389e41c2dc2d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1752 microversion: 2.1 time: 0.198102 Sep 01 15:07:39.727157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 469/937] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:39 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1752 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:39.838000 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c643af79-a94d-4a7a-94dd-46c2565e0d5d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:39.838681 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c643af79-a94d-4a7a-94dd-46c2565e0d5d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:39.846696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c643af79-a94d-4a7a-94dd-46c2565e0d5d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:39.847185 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c643af79-a94d-4a7a-94dd-46c2565e0d5d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:39.847622 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c643af79-a94d-4a7a-94dd-46c2565e0d5d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:39.848525 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c643af79-a94d-4a7a-94dd-46c2565e0d5d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:39.849011 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c643af79-a94d-4a7a-94dd-46c2565e0d5d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:39.849556 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c643af79-a94d-4a7a-94dd-46c2565e0d5d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:40.121645 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c643af79-a94d-4a7a-94dd-46c2565e0d5d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:40.131005 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c643af79-a94d-4a7a-94dd-46c2565e0d5d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1681 microversion: 2.1 time: 0.296865 Sep 01 15:07:40.132226 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 469/938] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:39 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1681 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:40.750868 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6a593312-c496-4b91-9429-f11b3e4257f0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:40.751488 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6a593312-c496-4b91-9429-f11b3e4257f0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:40.758067 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a593312-c496-4b91-9429-f11b3e4257f0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:40.758599 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a593312-c496-4b91-9429-f11b3e4257f0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:40.759037 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a593312-c496-4b91-9429-f11b3e4257f0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:40.759742 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a593312-c496-4b91-9429-f11b3e4257f0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:40.760200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a593312-c496-4b91-9429-f11b3e4257f0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:40.760623 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6a593312-c496-4b91-9429-f11b3e4257f0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:40.869022 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-e2df407f-1cdc-4f94-b0c4-17943f6ddbc1 req-3fdc7698-c2c1-4339-93c3-53bd796f82ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b073e711-0ab9-4edf-a2c6-a469c4d32303", "name": "network-vif-deleted", "tag": "58e3f0ce-ab70-4aa8-bc68-6a4e59b65dda"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:40.891708 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-e2df407f-1cdc-4f94-b0c4-17943f6ddbc1 req-3fdc7698-c2c1-4339-93c3-53bd796f82ee service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:40.892198 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-e2df407f-1cdc-4f94-b0c4-17943f6ddbc1 req-3fdc7698-c2c1-4339-93c3-53bd796f82ee service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:40.892631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-e2df407f-1cdc-4f94-b0c4-17943f6ddbc1 req-3fdc7698-c2c1-4339-93c3-53bd796f82ee service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:40.921418 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-e2df407f-1cdc-4f94-b0c4-17943f6ddbc1 req-3fdc7698-c2c1-4339-93c3-53bd796f82ee service nova] Creating event network-vif-deleted:58e3f0ce-ab70-4aa8-bc68-6a4e59b65dda for instance b073e711-0ab9-4edf-a2c6-a469c4d32303 on hv-cinder-85505 Sep 01 15:07:40.927291 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-e2df407f-1cdc-4f94-b0c4-17943f6ddbc1 req-3fdc7698-c2c1-4339-93c3-53bd796f82ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062927 Sep 01 15:07:40.928698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 470/939] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:07:40.975147 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-6a593312-c496-4b91-9429-f11b3e4257f0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:40.987110 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6a593312-c496-4b91-9429-f11b3e4257f0 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1752 microversion: 2.1 time: 0.240319 Sep 01 15:07:40.988451 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 470/940] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:40 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1752 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:41.163456 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:41.164400 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:41.171422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:41.171881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:41.172405 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:41.173591 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:41.174067 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:41.174573 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:41.208237 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:41.208734 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:41.209175 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:41.209630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lazy-loading 'fault' on Instance uuid b073e711-0ab9-4edf-a2c6-a469c4d32303 {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:07:41.254145 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:41.264251 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2ef9915a-2863-486d-b6f2-125b1dfd8269 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 200 len: 1331 microversion: 2.1 time: 0.104690 Sep 01 15:07:41.265184 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 471/941] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:41 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:42.011862 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-10bcef49-837a-4323-9d54-d1696f1d1440 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:42.012982 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-10bcef49-837a-4323-9d54-d1696f1d1440 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:42.019174 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-10bcef49-837a-4323-9d54-d1696f1d1440 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:42.019665 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-10bcef49-837a-4323-9d54-d1696f1d1440 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:42.020107 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-10bcef49-837a-4323-9d54-d1696f1d1440 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:42.020806 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-10bcef49-837a-4323-9d54-d1696f1d1440 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:42.021263 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-10bcef49-837a-4323-9d54-d1696f1d1440 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:42.021689 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-10bcef49-837a-4323-9d54-d1696f1d1440 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:42.167511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-10bcef49-837a-4323-9d54-d1696f1d1440 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:42.176878 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-10bcef49-837a-4323-9d54-d1696f1d1440 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1757 microversion: 2.1 time: 0.168923 Sep 01 15:07:42.177465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 471/942] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:42 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:42.288353 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:42.288990 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:42.295854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:42.296380 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:42.296826 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:42.297521 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:42.297982 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:42.298475 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:42.314359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 HTTP/1.1 Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:07:42.316010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:07:42.319282 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': 'b073e711-0ab9-4edf-a2c6-a469c4d32303'} Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:07:42.320961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:07:42.323842 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:07:42.325826 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:07:42.325826 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f0a83f99-e5b9-4165-9d17-18af6fca728c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 404 len: 111 microversion: 2.1 time: 0.032935 Sep 01 15:07:42.325826 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 472/943] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:42 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:07:42.329026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0045ab83-4467-4066-9d2d-643bd1b6cca3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '.version_select at 0x7fab73e81f70>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:42.350501 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0045ab83-4467-4066-9d2d-643bd1b6cca3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1541414469" status: 202 len: 0 microversion: 2.1 time: 0.027281 Sep 01 15:07:42.351003 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 472/944] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Sep 1 15:07:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1541414469 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:07:42.984808 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4dbe66a7-a657-40b4-8878-65484987a88e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: .version_select at 0x7fab73d2a670>, body: {"keypair": {"name": "tempest-keypair-565736365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQE2HOEWDrePSiiJxDSrdgKAGxVMHzZNy+79K/ufsZLVcXFGoxRDLzhX7f9ZFbXQiAK/IVvkY7UD10IkkONUpj2Oh9h2guhEVUHdT7PepaPC2PBj7g5c2Qnzf3NNJvN7A=="}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:43.003959 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-4dbe66a7-a657-40b4-8878-65484987a88e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for project 0b789cb75bc24a898888246a7745537e. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:07:43.008342 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-4dbe66a7-a657-40b4-8878-65484987a88e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for user 27653498cd0a4e089f1cbc43470182ee and project 0b789cb75bc24a898888246a7745537e. Resources: {'key_pairs'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:07:43.031710 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4dbe66a7-a657-40b4-8878-65484987a88e tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051338 Sep 01 15:07:43.032389 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 473/945] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 1 15:07:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:43.199424 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2167a676-2eef-48c7-8ce6-2c823d704c18 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:43.200643 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2167a676-2eef-48c7-8ce6-2c823d704c18 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:43.209102 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2167a676-2eef-48c7-8ce6-2c823d704c18 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:43.209625 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2167a676-2eef-48c7-8ce6-2c823d704c18 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:43.210341 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2167a676-2eef-48c7-8ce6-2c823d704c18 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:43.211053 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2167a676-2eef-48c7-8ce6-2c823d704c18 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:43.211509 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2167a676-2eef-48c7-8ce6-2c823d704c18 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:43.211938 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2167a676-2eef-48c7-8ce6-2c823d704c18 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:43.388124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2167a676-2eef-48c7-8ce6-2c823d704c18 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:43.394003 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-305754474", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-971708312", "security_groups": [{"name": "tempest-secgroup-smoke-247398210"}], "block_device_mapping_v2": [{"uuid": "aa34acfa-8ae1-4b70-b5a2-ac6069dfb86b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "056da220-38ab-4965-aff0-511e66373f02"}]}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:43.397464 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2167a676-2eef-48c7-8ce6-2c823d704c18 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1757 microversion: 2.1 time: 0.202448 Sep 01 15:07:43.398296 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 473/946] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:43 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1757 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:43.531200 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.network.neutron [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] validate_networks() for [('056da220-38ab-4965-aff0-511e66373f02', None, None, None, None, None)] {{(pid=120553) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:07:43.943317 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Flavor limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:07:43.944257 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Image limits 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:07:43.945236 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Flavor pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:07:43.945885 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Image pref 0:0:0 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:07:43.946536 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.virt.hardware [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:07:43.957910 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:43.958855 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:43.959855 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:43.960798 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:43.961371 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:43.962086 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:43.983921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Getting quotas for project 3e49151735934f21a2ea909842e36a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:07:43.990104 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.quota [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Getting quotas for user afa6212f31034e27a8d32f114937190e and project 3e49151735934f21a2ea909842e36a05. Resources: {'ram', 'instances', 'cores'} {{(pid=120553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:07:44.056513 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Going to run 1 instances... {{(pid=120553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:07:44.058903 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa34acfa-8ae1-4b70-b5a2-ac6069dfb86b',volume_size=None,volume_type=None)] {{(pid=120553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:07:44.214170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-fb725732-5a28-43be-8544-bb68917a4d5d tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.824905 Sep 01 15:07:44.215554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 474/947] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:07:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 15:07:44.229409 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-bacfa35d-59f0-49ef-b8cf-a940c30b7186 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:44.230939 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-bacfa35d-59f0-49ef-b8cf-a940c30b7186 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:44.301161 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-bacfa35d-59f0-49ef-b8cf-a940c30b7186 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:44.316583 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-bacfa35d-59f0-49ef-b8cf-a940c30b7186 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1093 microversion: 2.1 time: 0.091269 Sep 01 15:07:44.323089 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 474/948] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:44 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1093 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:44.421898 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-498a0c2b-e22f-4a2d-8718-dcc2b6cf7a71 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:44.422625 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-498a0c2b-e22f-4a2d-8718-dcc2b6cf7a71 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:44.433240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-498a0c2b-e22f-4a2d-8718-dcc2b6cf7a71 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:44.433765 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-498a0c2b-e22f-4a2d-8718-dcc2b6cf7a71 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:44.438529 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-498a0c2b-e22f-4a2d-8718-dcc2b6cf7a71 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:44.440584 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-498a0c2b-e22f-4a2d-8718-dcc2b6cf7a71 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:44.442296 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-498a0c2b-e22f-4a2d-8718-dcc2b6cf7a71 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:44.443170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-498a0c2b-e22f-4a2d-8718-dcc2b6cf7a71 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:44.453550 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-374819813", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bf8cd5c2-fc41-47d1-b1ef-d6d4b64d51b6"}], "security_groups": [{"name": "tempest-securitygroup--1648858943"}], "key_name": "tempest-keypair-565736365", "user_data": "}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:44.581224 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.network.neutron [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] validate_networks() for [('bf8cd5c2-fc41-47d1-b1ef-d6d4b64d51b6', None, None, None, None, None)] {{(pid=120554) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:07:44.715640 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-498a0c2b-e22f-4a2d-8718-dcc2b6cf7a71 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:44.726432 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-498a0c2b-e22f-4a2d-8718-dcc2b6cf7a71 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1757 microversion: 2.1 time: 0.310248 Sep 01 15:07:44.727028 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 475/949] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:44 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1757 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:45.000626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Flavor limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:07:45.001060 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Image limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:07:45.001539 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Flavor pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:07:45.001949 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Image pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:07:45.002411 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:07:45.011836 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:45.012372 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:45.012848 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:45.014162 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:45.014636 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:45.015069 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:45.033332 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for project 0b789cb75bc24a898888246a7745537e. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:07:45.037689 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Getting quotas for user 27653498cd0a4e089f1cbc43470182ee and project 0b789cb75bc24a898888246a7745537e. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:07:45.049313 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Going to run 1 instances... {{(pid=120554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:07:45.051655 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:07:45.100323 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-dea8aa8a-eac6-4ec7-b9d0-6e92e46974a5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.651226 Sep 01 15:07:45.100975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 475/950] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:07:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 15:07:45.111727 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a3ac5420-08a4-472d-8f73-4f9c4917f7ab tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:45.112484 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a3ac5420-08a4-472d-8f73-4f9c4917f7ab tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:45.170463 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a3ac5420-08a4-472d-8f73-4f9c4917f7ab tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:45.178919 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a3ac5420-08a4-472d-8f73-4f9c4917f7ab tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1240 microversion: 2.1 time: 0.071060 Sep 01 15:07:45.179478 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 476/951] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:45 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:45.340615 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-89091234-b36c-4312-9184-0778e4d605fc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:45.341244 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-89091234-b36c-4312-9184-0778e4d605fc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:45.348267 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89091234-b36c-4312-9184-0778e4d605fc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:45.348753 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89091234-b36c-4312-9184-0778e4d605fc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:45.349190 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89091234-b36c-4312-9184-0778e4d605fc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:45.349879 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89091234-b36c-4312-9184-0778e4d605fc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:45.350360 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89091234-b36c-4312-9184-0778e4d605fc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:45.350788 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-89091234-b36c-4312-9184-0778e4d605fc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:45.449951 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-89091234-b36c-4312-9184-0778e4d605fc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:45.459534 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-89091234-b36c-4312-9184-0778e4d605fc tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1191 microversion: 2.1 time: 0.123191 Sep 01 15:07:45.461430 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 476/952] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:45 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1191 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:45.749929 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-03a38f38-7101-4337-b6a4-03db95931e99 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:45.750772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-03a38f38-7101-4337-b6a4-03db95931e99 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:45.760456 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-03a38f38-7101-4337-b6a4-03db95931e99 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:45.761307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-03a38f38-7101-4337-b6a4-03db95931e99 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:45.761908 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-03a38f38-7101-4337-b6a4-03db95931e99 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:45.763057 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-03a38f38-7101-4337-b6a4-03db95931e99 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:45.765104 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-03a38f38-7101-4337-b6a4-03db95931e99 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:45.766307 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-03a38f38-7101-4337-b6a4-03db95931e99 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:46.013538 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-03a38f38-7101-4337-b6a4-03db95931e99 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:46.023893 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-03a38f38-7101-4337-b6a4-03db95931e99 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1757 microversion: 2.1 time: 0.278389 Sep 01 15:07:46.024472 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 477/953] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:45 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1757 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:07:46.202328 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c9c76376-c1f4-4f3c-93e9-177d7c89038a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:46.203121 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c9c76376-c1f4-4f3c-93e9-177d7c89038a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:46.209823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9c76376-c1f4-4f3c-93e9-177d7c89038a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:46.210513 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9c76376-c1f4-4f3c-93e9-177d7c89038a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:46.211067 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9c76376-c1f4-4f3c-93e9-177d7c89038a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:46.212278 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9c76376-c1f4-4f3c-93e9-177d7c89038a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:46.212929 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9c76376-c1f4-4f3c-93e9-177d7c89038a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:46.213590 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c9c76376-c1f4-4f3c-93e9-177d7c89038a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:46.294503 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c9c76376-c1f4-4f3c-93e9-177d7c89038a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:46.304893 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c9c76376-c1f4-4f3c-93e9-177d7c89038a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1292 microversion: 2.1 time: 0.108059 Sep 01 15:07:46.307055 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 477/954] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:46 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1292 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:46.481038 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7e44bd4d-cd30-4721-8bd5-a194a8a44234 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:46.481672 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7e44bd4d-cd30-4721-8bd5-a194a8a44234 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:46.489764 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e44bd4d-cd30-4721-8bd5-a194a8a44234 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:46.490545 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e44bd4d-cd30-4721-8bd5-a194a8a44234 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:46.491217 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e44bd4d-cd30-4721-8bd5-a194a8a44234 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:46.492088 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e44bd4d-cd30-4721-8bd5-a194a8a44234 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:46.492705 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e44bd4d-cd30-4721-8bd5-a194a8a44234 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:46.493609 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e44bd4d-cd30-4721-8bd5-a194a8a44234 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:46.787025 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-7e44bd4d-cd30-4721-8bd5-a194a8a44234 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:46.796247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7e44bd4d-cd30-4721-8bd5-a194a8a44234 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1264 microversion: 2.1 time: 0.318929 Sep 01 15:07:46.796852 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 478/955] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:46 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1264 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:47.047976 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c2a60156-c6c1-4f7e-bbd3-db8fa91c719a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:47.048566 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c2a60156-c6c1-4f7e-bbd3-db8fa91c719a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:47.055682 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2a60156-c6c1-4f7e-bbd3-db8fa91c719a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:47.056165 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2a60156-c6c1-4f7e-bbd3-db8fa91c719a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:47.056614 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2a60156-c6c1-4f7e-bbd3-db8fa91c719a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:47.057331 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2a60156-c6c1-4f7e-bbd3-db8fa91c719a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:47.057795 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2a60156-c6c1-4f7e-bbd3-db8fa91c719a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:47.058253 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c2a60156-c6c1-4f7e-bbd3-db8fa91c719a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:47.214946 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c2a60156-c6c1-4f7e-bbd3-db8fa91c719a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:47.224282 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c2a60156-c6c1-4f7e-bbd3-db8fa91c719a tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1757 microversion: 2.1 time: 0.181585 Sep 01 15:07:47.225005 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 478/956] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:47 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:47.330044 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2e44f5de-5de1-459a-9c2c-bf903c37b3e5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:47.330770 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2e44f5de-5de1-459a-9c2c-bf903c37b3e5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:47.336891 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2e44f5de-5de1-459a-9c2c-bf903c37b3e5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:47.337378 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2e44f5de-5de1-459a-9c2c-bf903c37b3e5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:47.337813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2e44f5de-5de1-459a-9c2c-bf903c37b3e5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:47.338557 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2e44f5de-5de1-459a-9c2c-bf903c37b3e5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:47.339021 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2e44f5de-5de1-459a-9c2c-bf903c37b3e5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:47.339448 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2e44f5de-5de1-459a-9c2c-bf903c37b3e5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:47.345814 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:47.477827 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2e44f5de-5de1-459a-9c2c-bf903c37b3e5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:47.485693 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2e44f5de-5de1-459a-9c2c-bf903c37b3e5 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1298 microversion: 2.1 time: 0.160011 Sep 01 15:07:47.486300 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 479/957] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:47 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1298 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:47.603143 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-75df94d7-c339-4be1-8ad5-a44e1752ec3f req-aee478f6-e43d-4e7d-8eb0-bfb6c06d0628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be64d588-2a22-4c84-b763-dbd89e476a69", "tag": "4ae7b8f7-3330-4928-b35e-6143ba6cd144"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:47.613794 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-75df94d7-c339-4be1-8ad5-a44e1752ec3f req-aee478f6-e43d-4e7d-8eb0-bfb6c06d0628 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:47.614389 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-75df94d7-c339-4be1-8ad5-a44e1752ec3f req-aee478f6-e43d-4e7d-8eb0-bfb6c06d0628 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:47.614837 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-75df94d7-c339-4be1-8ad5-a44e1752ec3f req-aee478f6-e43d-4e7d-8eb0-bfb6c06d0628 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:47.633244 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-75df94d7-c339-4be1-8ad5-a44e1752ec3f req-aee478f6-e43d-4e7d-8eb0-bfb6c06d0628 service nova] Creating event network-changed:4ae7b8f7-3330-4928-b35e-6143ba6cd144 for instance be64d588-2a22-4c84-b763-dbd89e476a69 on hv-cinder-85505 Sep 01 15:07:47.642605 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-75df94d7-c339-4be1-8ad5-a44e1752ec3f req-aee478f6-e43d-4e7d-8eb0-bfb6c06d0628 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042691 Sep 01 15:07:47.643784 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 479/958] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:47.817948 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-fe3706ff-db52-487a-9a1d-fd78367d5244 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:47.818651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-fe3706ff-db52-487a-9a1d-fd78367d5244 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:47.825650 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fe3706ff-db52-487a-9a1d-fd78367d5244 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:47.826792 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fe3706ff-db52-487a-9a1d-fd78367d5244 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:47.827239 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fe3706ff-db52-487a-9a1d-fd78367d5244 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:47.827959 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fe3706ff-db52-487a-9a1d-fd78367d5244 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:47.831744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fe3706ff-db52-487a-9a1d-fd78367d5244 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:47.831744 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-fe3706ff-db52-487a-9a1d-fd78367d5244 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:48.249700 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-8bf19e11-b545-4832-82d2-6658c2a0fab3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:48.250446 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-8bf19e11-b545-4832-82d2-6658c2a0fab3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:48.264089 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bf19e11-b545-4832-82d2-6658c2a0fab3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:48.264961 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bf19e11-b545-4832-82d2-6658c2a0fab3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:48.267599 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bf19e11-b545-4832-82d2-6658c2a0fab3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:48.268747 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bf19e11-b545-4832-82d2-6658c2a0fab3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:48.269245 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bf19e11-b545-4832-82d2-6658c2a0fab3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:48.269696 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-8bf19e11-b545-4832-82d2-6658c2a0fab3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:48.294270 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:48.347316 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-fe3706ff-db52-487a-9a1d-fd78367d5244 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:48.360281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-fe3706ff-db52-487a-9a1d-fd78367d5244 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1264 microversion: 2.1 time: 0.546013 Sep 01 15:07:48.361828 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 480/959] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:47 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1264 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:48.460752 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-8bf19e11-b545-4832-82d2-6658c2a0fab3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:48.478074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-8bf19e11-b545-4832-82d2-6658c2a0fab3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1757 microversion: 2.1 time: 0.228889 Sep 01 15:07:48.478074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 480/960] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:48 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1757 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:07:48.507993 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c12d1abb-680b-4002-aa3c-22ec3c40c46d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:48.508729 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c12d1abb-680b-4002-aa3c-22ec3c40c46d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:48.516791 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c12d1abb-680b-4002-aa3c-22ec3c40c46d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:48.517277 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c12d1abb-680b-4002-aa3c-22ec3c40c46d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:48.517967 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c12d1abb-680b-4002-aa3c-22ec3c40c46d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:48.523840 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c12d1abb-680b-4002-aa3c-22ec3c40c46d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:48.523840 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c12d1abb-680b-4002-aa3c-22ec3c40c46d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:48.523840 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c12d1abb-680b-4002-aa3c-22ec3c40c46d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:48.868587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-c12d1abb-680b-4002-aa3c-22ec3c40c46d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:48.880068 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c12d1abb-680b-4002-aa3c-22ec3c40c46d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1366 microversion: 2.1 time: 0.372809 Sep 01 15:07:48.880068 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 481/961] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:48 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:49.382321 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5cb431ec-f09b-4e58-9740-173a181510a8 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:49.383985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5cb431ec-f09b-4e58-9740-173a181510a8 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:49.390477 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5cb431ec-f09b-4e58-9740-173a181510a8 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:49.391285 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5cb431ec-f09b-4e58-9740-173a181510a8 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:49.391785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5cb431ec-f09b-4e58-9740-173a181510a8 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:49.392563 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5cb431ec-f09b-4e58-9740-173a181510a8 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:49.393074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5cb431ec-f09b-4e58-9740-173a181510a8 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:49.393854 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5cb431ec-f09b-4e58-9740-173a181510a8 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:49.496363 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b84f3aa3-ad82-46c8-ace8-fad4b49bafbe tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:49.497539 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b84f3aa3-ad82-46c8-ace8-fad4b49bafbe tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:49.507407 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b84f3aa3-ad82-46c8-ace8-fad4b49bafbe tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:49.508839 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b84f3aa3-ad82-46c8-ace8-fad4b49bafbe tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:49.509583 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b84f3aa3-ad82-46c8-ace8-fad4b49bafbe tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:49.511112 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b84f3aa3-ad82-46c8-ace8-fad4b49bafbe tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:49.511820 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b84f3aa3-ad82-46c8-ace8-fad4b49bafbe tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:49.512185 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b84f3aa3-ad82-46c8-ace8-fad4b49bafbe tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:49.553470 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-5cb431ec-f09b-4e58-9740-173a181510a8 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:49.564059 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5cb431ec-f09b-4e58-9740-173a181510a8 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1264 microversion: 2.1 time: 0.186101 Sep 01 15:07:49.564846 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 481/962] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:49 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:49.663338 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-ab226165-9333-4f8a-a187-d11869538f7f req-19034b33-b41b-418d-82d2-eaa030d69a39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c11ebba-4f71-4422-a5f2-4688b22ed58c", "tag": "88ee1ffc-500b-42df-b198-183844a08775"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:49.674285 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-ab226165-9333-4f8a-a187-d11869538f7f req-19034b33-b41b-418d-82d2-eaa030d69a39 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:49.674775 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-ab226165-9333-4f8a-a187-d11869538f7f req-19034b33-b41b-418d-82d2-eaa030d69a39 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:49.675220 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-ab226165-9333-4f8a-a187-d11869538f7f req-19034b33-b41b-418d-82d2-eaa030d69a39 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:49.687712 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-ab226165-9333-4f8a-a187-d11869538f7f req-19034b33-b41b-418d-82d2-eaa030d69a39 service nova] Creating event network-changed:88ee1ffc-500b-42df-b198-183844a08775 for instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c on hv-cinder-85505 Sep 01 15:07:49.692539 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-ab226165-9333-4f8a-a187-d11869538f7f req-19034b33-b41b-418d-82d2-eaa030d69a39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032866 Sep 01 15:07:49.693157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 482/963] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:07:49.899199 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-fda52a72-b1dc-4225-8b45-265ae552a33a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:49.899919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-fda52a72-b1dc-4225-8b45-265ae552a33a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:49.907019 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fda52a72-b1dc-4225-8b45-265ae552a33a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:49.907520 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fda52a72-b1dc-4225-8b45-265ae552a33a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:49.907969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fda52a72-b1dc-4225-8b45-265ae552a33a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:49.908687 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fda52a72-b1dc-4225-8b45-265ae552a33a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:49.909155 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fda52a72-b1dc-4225-8b45-265ae552a33a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:49.909589 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fda52a72-b1dc-4225-8b45-265ae552a33a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:49.927191 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b84f3aa3-ad82-46c8-ace8-fad4b49bafbe tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:49.935742 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b84f3aa3-ad82-46c8-ace8-fad4b49bafbe tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1757 microversion: 2.1 time: 0.443479 Sep 01 15:07:49.936562 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 482/964] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:49 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1757 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:07:50.065589 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-fda52a72-b1dc-4225-8b45-265ae552a33a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:50.074019 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-fda52a72-b1dc-4225-8b45-265ae552a33a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1366 microversion: 2.1 time: 0.179159 Sep 01 15:07:50.074891 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 483/965] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:49 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:07:50.585481 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-760a8a59-837a-4d8e-b60a-718f71375cf7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:50.586103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-760a8a59-837a-4d8e-b60a-718f71375cf7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:50.592210 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-760a8a59-837a-4d8e-b60a-718f71375cf7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:50.592702 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-760a8a59-837a-4d8e-b60a-718f71375cf7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:50.593146 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-760a8a59-837a-4d8e-b60a-718f71375cf7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:50.593850 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-760a8a59-837a-4d8e-b60a-718f71375cf7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:50.594339 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-760a8a59-837a-4d8e-b60a-718f71375cf7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:50.594772 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-760a8a59-837a-4d8e-b60a-718f71375cf7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:50.734436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-760a8a59-837a-4d8e-b60a-718f71375cf7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:50.745084 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-760a8a59-837a-4d8e-b60a-718f71375cf7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1264 microversion: 2.1 time: 0.163424 Sep 01 15:07:50.745662 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 483/966] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:50 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:50.957380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f2d288d2-7d0d-4138-8d8e-b28280be4dc6 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:50.957944 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f2d288d2-7d0d-4138-8d8e-b28280be4dc6 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:50.964660 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2d288d2-7d0d-4138-8d8e-b28280be4dc6 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:50.965156 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2d288d2-7d0d-4138-8d8e-b28280be4dc6 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:50.965597 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2d288d2-7d0d-4138-8d8e-b28280be4dc6 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:50.966330 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2d288d2-7d0d-4138-8d8e-b28280be4dc6 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:50.966888 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2d288d2-7d0d-4138-8d8e-b28280be4dc6 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:50.967320 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f2d288d2-7d0d-4138-8d8e-b28280be4dc6 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:51.095506 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1fac19e5-a504-4a33-abca-5fb763358cdf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:51.096324 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1fac19e5-a504-4a33-abca-5fb763358cdf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:51.103827 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1fac19e5-a504-4a33-abca-5fb763358cdf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:51.104243 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1fac19e5-a504-4a33-abca-5fb763358cdf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:51.104885 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1fac19e5-a504-4a33-abca-5fb763358cdf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:51.105605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1fac19e5-a504-4a33-abca-5fb763358cdf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:51.106142 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1fac19e5-a504-4a33-abca-5fb763358cdf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:51.106605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1fac19e5-a504-4a33-abca-5fb763358cdf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:51.115539 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f2d288d2-7d0d-4138-8d8e-b28280be4dc6 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:51.125054 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f2d288d2-7d0d-4138-8d8e-b28280be4dc6 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1757 microversion: 2.1 time: 0.171602 Sep 01 15:07:51.125668 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 484/967] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:50 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:51.327751 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1fac19e5-a504-4a33-abca-5fb763358cdf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:51.335849 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1fac19e5-a504-4a33-abca-5fb763358cdf tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1366 microversion: 2.1 time: 0.244335 Sep 01 15:07:51.336438 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 484/968] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:51 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:07:51.766763 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-dcc20a18-cb6b-4bc8-982e-41a970377ddf tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:51.767301 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-dcc20a18-cb6b-4bc8-982e-41a970377ddf tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:51.773447 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dcc20a18-cb6b-4bc8-982e-41a970377ddf tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:51.773932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dcc20a18-cb6b-4bc8-982e-41a970377ddf tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:51.774423 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dcc20a18-cb6b-4bc8-982e-41a970377ddf tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:51.775121 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dcc20a18-cb6b-4bc8-982e-41a970377ddf tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:51.775573 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dcc20a18-cb6b-4bc8-982e-41a970377ddf tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:51.775996 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-dcc20a18-cb6b-4bc8-982e-41a970377ddf tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:51.915953 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-dcc20a18-cb6b-4bc8-982e-41a970377ddf tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:51.924755 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-dcc20a18-cb6b-4bc8-982e-41a970377ddf tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1264 microversion: 2.1 time: 0.162439 Sep 01 15:07:51.925328 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 485/969] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:51 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:07:52.149556 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8591658e-4921-4254-a708-d7aa9000c04d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:52.150169 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8591658e-4921-4254-a708-d7aa9000c04d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:52.156513 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8591658e-4921-4254-a708-d7aa9000c04d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:52.156993 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8591658e-4921-4254-a708-d7aa9000c04d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:52.157462 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8591658e-4921-4254-a708-d7aa9000c04d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:52.158169 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8591658e-4921-4254-a708-d7aa9000c04d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:52.159260 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8591658e-4921-4254-a708-d7aa9000c04d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:52.159699 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8591658e-4921-4254-a708-d7aa9000c04d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:52.311732 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8591658e-4921-4254-a708-d7aa9000c04d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:52.320246 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8591658e-4921-4254-a708-d7aa9000c04d tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1760 microversion: 2.1 time: 0.175094 Sep 01 15:07:52.320807 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 485/970] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:52 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:52.357924 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e857ae23-3842-4b9e-9190-fa4708958a97 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:52.358701 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e857ae23-3842-4b9e-9190-fa4708958a97 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:52.366093 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e857ae23-3842-4b9e-9190-fa4708958a97 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:52.366614 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e857ae23-3842-4b9e-9190-fa4708958a97 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:52.367047 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e857ae23-3842-4b9e-9190-fa4708958a97 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:52.367744 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e857ae23-3842-4b9e-9190-fa4708958a97 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:52.368200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e857ae23-3842-4b9e-9190-fa4708958a97 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:52.368623 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e857ae23-3842-4b9e-9190-fa4708958a97 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:52.511459 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-e857ae23-3842-4b9e-9190-fa4708958a97 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:52.519295 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e857ae23-3842-4b9e-9190-fa4708958a97 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1366 microversion: 2.1 time: 0.166081 Sep 01 15:07:52.519856 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 486/971] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:52 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:52.945197 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1f42eb24-73f4-4cf6-8a5a-d1492e8df898 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:52.945789 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1f42eb24-73f4-4cf6-8a5a-d1492e8df898 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:52.951949 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1f42eb24-73f4-4cf6-8a5a-d1492e8df898 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:52.952434 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1f42eb24-73f4-4cf6-8a5a-d1492e8df898 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:52.952881 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1f42eb24-73f4-4cf6-8a5a-d1492e8df898 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:52.953572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1f42eb24-73f4-4cf6-8a5a-d1492e8df898 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:52.954033 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1f42eb24-73f4-4cf6-8a5a-d1492e8df898 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:52.954500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1f42eb24-73f4-4cf6-8a5a-d1492e8df898 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:53.090339 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-1f42eb24-73f4-4cf6-8a5a-d1492e8df898 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:53.098680 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1f42eb24-73f4-4cf6-8a5a-d1492e8df898 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1264 microversion: 2.1 time: 0.157387 Sep 01 15:07:53.099241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 486/972] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:52 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:53.540411 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-c84ce55b-e387-4dfd-b45e-ff0902474ae3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:53.541004 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-c84ce55b-e387-4dfd-b45e-ff0902474ae3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:53.547905 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c84ce55b-e387-4dfd-b45e-ff0902474ae3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:53.548412 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c84ce55b-e387-4dfd-b45e-ff0902474ae3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:53.548847 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c84ce55b-e387-4dfd-b45e-ff0902474ae3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:53.549539 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c84ce55b-e387-4dfd-b45e-ff0902474ae3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:53.549995 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c84ce55b-e387-4dfd-b45e-ff0902474ae3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:53.550461 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-c84ce55b-e387-4dfd-b45e-ff0902474ae3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:53.697944 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-c84ce55b-e387-4dfd-b45e-ff0902474ae3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:53.706731 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-c84ce55b-e387-4dfd-b45e-ff0902474ae3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1366 microversion: 2.1 time: 0.169979 Sep 01 15:07:53.707315 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 487/973] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:53 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:53.916537 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-67bef824-ba81-44e6-8cfd-6aa25a640918 req-58d5d600-037a-4bab-b6ef-9e954c8fec24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c11ebba-4f71-4422-a5f2-4688b22ed58c", "name": "network-vif-plugged", "status": "completed", "tag": "88ee1ffc-500b-42df-b198-183844a08775"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:53.932711 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-67bef824-ba81-44e6-8cfd-6aa25a640918 req-58d5d600-037a-4bab-b6ef-9e954c8fec24 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:53.933488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-67bef824-ba81-44e6-8cfd-6aa25a640918 req-58d5d600-037a-4bab-b6ef-9e954c8fec24 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:53.934047 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-67bef824-ba81-44e6-8cfd-6aa25a640918 req-58d5d600-037a-4bab-b6ef-9e954c8fec24 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:53.947702 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-67bef824-ba81-44e6-8cfd-6aa25a640918 req-58d5d600-037a-4bab-b6ef-9e954c8fec24 service nova] Creating event network-vif-plugged:88ee1ffc-500b-42df-b198-183844a08775 for instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c on hv-cinder-85505 Sep 01 15:07:53.953096 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-67bef824-ba81-44e6-8cfd-6aa25a640918 req-58d5d600-037a-4bab-b6ef-9e954c8fec24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043717 Sep 01 15:07:53.953708 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 487/974] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:54.119118 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-73c9f18b-abcb-42ae-9683-ef1406188312 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:54.119773 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-73c9f18b-abcb-42ae-9683-ef1406188312 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:54.126456 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73c9f18b-abcb-42ae-9683-ef1406188312 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:54.126939 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73c9f18b-abcb-42ae-9683-ef1406188312 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:54.127370 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73c9f18b-abcb-42ae-9683-ef1406188312 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:54.128069 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73c9f18b-abcb-42ae-9683-ef1406188312 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:54.128528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73c9f18b-abcb-42ae-9683-ef1406188312 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:54.128946 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-73c9f18b-abcb-42ae-9683-ef1406188312 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:54.271412 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-73c9f18b-abcb-42ae-9683-ef1406188312 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:54.279765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-73c9f18b-abcb-42ae-9683-ef1406188312 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1264 microversion: 2.1 time: 0.164061 Sep 01 15:07:54.280333 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 488/975] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:54 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:54.724787 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:54.729444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e74f3bf0-91a1-4800-a877-a75536376628 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:54.730192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e74f3bf0-91a1-4800-a877-a75536376628 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:54.737074 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e74f3bf0-91a1-4800-a877-a75536376628 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:54.737575 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e74f3bf0-91a1-4800-a877-a75536376628 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:54.738045 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e74f3bf0-91a1-4800-a877-a75536376628 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:54.739500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e74f3bf0-91a1-4800-a877-a75536376628 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:54.739500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e74f3bf0-91a1-4800-a877-a75536376628 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:54.739773 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e74f3bf0-91a1-4800-a877-a75536376628 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:54.925257 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e74f3bf0-91a1-4800-a877-a75536376628 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:54.933562 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e74f3bf0-91a1-4800-a877-a75536376628 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1366 microversion: 2.1 time: 0.209620 Sep 01 15:07:54.934130 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 488/976] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:54 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:07:55.300747 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f7f82f7a-0bb4-42cf-988d-9bd2561b630b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:55.301361 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f7f82f7a-0bb4-42cf-988d-9bd2561b630b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:55.303798 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:55.304491 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=8 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:55.311679 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f7f82f7a-0bb4-42cf-988d-9bd2561b630b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:55.312168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f7f82f7a-0bb4-42cf-988d-9bd2561b630b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:55.312604 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f7f82f7a-0bb4-42cf-988d-9bd2561b630b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:55.313299 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f7f82f7a-0bb4-42cf-988d-9bd2561b630b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:55.313752 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f7f82f7a-0bb4-42cf-988d-9bd2561b630b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:55.314179 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f7f82f7a-0bb4-42cf-988d-9bd2561b630b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:55.447309 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f7f82f7a-0bb4-42cf-988d-9bd2561b630b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:55.455210 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f7f82f7a-0bb4-42cf-988d-9bd2561b630b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1264 microversion: 2.1 time: 0.158250 Sep 01 15:07:55.455783 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 489/977] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:55 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:55.954483 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f307739a-1039-44f9-bb17-577723fa7540 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:55.955527 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f307739a-1039-44f9-bb17-577723fa7540 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:55.957283 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=12 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:55.964066 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f307739a-1039-44f9-bb17-577723fa7540 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:55.964558 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f307739a-1039-44f9-bb17-577723fa7540 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:55.965021 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f307739a-1039-44f9-bb17-577723fa7540 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:55.965749 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f307739a-1039-44f9-bb17-577723fa7540 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:55.966813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f307739a-1039-44f9-bb17-577723fa7540 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:55.967244 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f307739a-1039-44f9-bb17-577723fa7540 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:56.103103 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-f307739a-1039-44f9-bb17-577723fa7540 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:56.113637 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f307739a-1039-44f9-bb17-577723fa7540 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1366 microversion: 2.1 time: 0.163068 Sep 01 15:07:56.121852 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 489/978] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:55 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:56.475754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a4c398dc-5434-458f-9daf-e57f5879a483 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:56.476401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a4c398dc-5434-458f-9daf-e57f5879a483 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:56.478860 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:56.484212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4c398dc-5434-458f-9daf-e57f5879a483 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:56.484708 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4c398dc-5434-458f-9daf-e57f5879a483 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:56.485153 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4c398dc-5434-458f-9daf-e57f5879a483 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:56.485870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4c398dc-5434-458f-9daf-e57f5879a483 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:56.486363 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4c398dc-5434-458f-9daf-e57f5879a483 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:56.486795 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a4c398dc-5434-458f-9daf-e57f5879a483 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:56.629100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-a4c398dc-5434-458f-9daf-e57f5879a483 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:56.636947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a4c398dc-5434-458f-9daf-e57f5879a483 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1264 microversion: 2.1 time: 0.165058 Sep 01 15:07:56.637526 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 490/979] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:56 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:57.142504 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-89e06888-6520-46db-8b62-58297770fd7a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:57.143126 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-89e06888-6520-46db-8b62-58297770fd7a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:57.145505 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:07:57.151110 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-89e06888-6520-46db-8b62-58297770fd7a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:57.151608 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-89e06888-6520-46db-8b62-58297770fd7a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:57.152052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-89e06888-6520-46db-8b62-58297770fd7a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:57.152758 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-89e06888-6520-46db-8b62-58297770fd7a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:57.153219 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-89e06888-6520-46db-8b62-58297770fd7a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:57.153651 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-89e06888-6520-46db-8b62-58297770fd7a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:57.288068 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-89e06888-6520-46db-8b62-58297770fd7a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:57.296920 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-89e06888-6520-46db-8b62-58297770fd7a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1556 microversion: 2.1 time: 0.158697 Sep 01 15:07:57.297489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 490/980] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:57 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:57.319612 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-bc51f3fa-d1fe-4894-bdc3-495d2613f6c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:57.320228 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-bc51f3fa-d1fe-4894-bdc3-495d2613f6c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:57.326831 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bc51f3fa-d1fe-4894-bdc3-495d2613f6c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:57.327322 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bc51f3fa-d1fe-4894-bdc3-495d2613f6c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:57.327772 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bc51f3fa-d1fe-4894-bdc3-495d2613f6c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:57.328507 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bc51f3fa-d1fe-4894-bdc3-495d2613f6c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:57.328966 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bc51f3fa-d1fe-4894-bdc3-495d2613f6c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:57.329398 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-bc51f3fa-d1fe-4894-bdc3-495d2613f6c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:57.407515 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-bc51f3fa-d1fe-4894-bdc3-495d2613f6c2 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094411 Sep 01 15:07:57.408120 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 491/981] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 1 15:07:57 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:57.658963 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7058916d-2d22-4d2b-abde-2ba3d9a353b7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:57.659757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7058916d-2d22-4d2b-abde-2ba3d9a353b7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:57.670143 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7058916d-2d22-4d2b-abde-2ba3d9a353b7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:57.675963 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7058916d-2d22-4d2b-abde-2ba3d9a353b7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:57.676432 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7058916d-2d22-4d2b-abde-2ba3d9a353b7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:57.677399 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7058916d-2d22-4d2b-abde-2ba3d9a353b7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:57.677890 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7058916d-2d22-4d2b-abde-2ba3d9a353b7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:57.678364 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7058916d-2d22-4d2b-abde-2ba3d9a353b7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:57.846492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-7058916d-2d22-4d2b-abde-2ba3d9a353b7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:57.850947 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-3b958e2e-861f-48fe-a798-8cb0b8cbc2f2 req-bffc310d-aacb-49a3-a948-df698792449e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be64d588-2a22-4c84-b763-dbd89e476a69", "name": "network-vif-plugged", "status": "completed", "tag": "4ae7b8f7-3330-4928-b35e-6143ba6cd144"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:57.863369 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7058916d-2d22-4d2b-abde-2ba3d9a353b7 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1264 microversion: 2.1 time: 0.208281 Sep 01 15:07:57.864754 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 491/982] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:57 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:07:57.865018 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3b958e2e-861f-48fe-a798-8cb0b8cbc2f2 req-bffc310d-aacb-49a3-a948-df698792449e service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:57.865664 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3b958e2e-861f-48fe-a798-8cb0b8cbc2f2 req-bffc310d-aacb-49a3-a948-df698792449e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:57.866181 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3b958e2e-861f-48fe-a798-8cb0b8cbc2f2 req-bffc310d-aacb-49a3-a948-df698792449e service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:57.879106 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-3b958e2e-861f-48fe-a798-8cb0b8cbc2f2 req-bffc310d-aacb-49a3-a948-df698792449e service nova] Creating event network-vif-plugged:4ae7b8f7-3330-4928-b35e-6143ba6cd144 for instance be64d588-2a22-4c84-b763-dbd89e476a69 on hv-cinder-85505 Sep 01 15:07:57.884633 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-3b958e2e-861f-48fe-a798-8cb0b8cbc2f2 req-bffc310d-aacb-49a3-a948-df698792449e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043108 Sep 01 15:07:57.885706 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 492/983] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:07:58.651638 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-bed365e8-5d40-4204-abb9-b227a73602d3 req-980dafb3-0535-4548-bb1f-ed7bb43c1bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c11ebba-4f71-4422-a5f2-4688b22ed58c", "tag": "88ee1ffc-500b-42df-b198-183844a08775"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:07:58.664372 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-bed365e8-5d40-4204-abb9-b227a73602d3 req-980dafb3-0535-4548-bb1f-ed7bb43c1bb4 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:58.664863 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-bed365e8-5d40-4204-abb9-b227a73602d3 req-980dafb3-0535-4548-bb1f-ed7bb43c1bb4 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:58.665297 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-bed365e8-5d40-4204-abb9-b227a73602d3 req-980dafb3-0535-4548-bb1f-ed7bb43c1bb4 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:58.678349 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-bed365e8-5d40-4204-abb9-b227a73602d3 req-980dafb3-0535-4548-bb1f-ed7bb43c1bb4 service nova] Creating event network-changed:88ee1ffc-500b-42df-b198-183844a08775 for instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c on hv-cinder-85505 Sep 01 15:07:58.683229 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-bed365e8-5d40-4204-abb9-b227a73602d3 req-980dafb3-0535-4548-bb1f-ed7bb43c1bb4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035324 Sep 01 15:07:58.683824 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 492/984] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:07:58.888434 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-fbc468a6-e7f8-4b64-971d-669717b8cd61 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:07:58.889698 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-fbc468a6-e7f8-4b64-971d-669717b8cd61 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:07:58.900434 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fbc468a6-e7f8-4b64-971d-669717b8cd61 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:58.901324 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fbc468a6-e7f8-4b64-971d-669717b8cd61 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:58.902121 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fbc468a6-e7f8-4b64-971d-669717b8cd61 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:58.903421 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fbc468a6-e7f8-4b64-971d-669717b8cd61 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:07:58.904769 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fbc468a6-e7f8-4b64-971d-669717b8cd61 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:07:58.905567 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-fbc468a6-e7f8-4b64-971d-669717b8cd61 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:07:59.071559 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-fbc468a6-e7f8-4b64-971d-669717b8cd61 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:07:59.079848 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-fbc468a6-e7f8-4b64-971d-669717b8cd61 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1264 microversion: 2.1 time: 0.197639 Sep 01 15:07:59.080735 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 493/985] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:07:58 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:08:00.102129 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-759b5002-d125-4e54-897f-a76eab08f976 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:00.102918 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-759b5002-d125-4e54-897f-a76eab08f976 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:00.109885 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-759b5002-d125-4e54-897f-a76eab08f976 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:00.110419 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-759b5002-d125-4e54-897f-a76eab08f976 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:00.110871 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-759b5002-d125-4e54-897f-a76eab08f976 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:00.111587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-759b5002-d125-4e54-897f-a76eab08f976 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:00.112059 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-759b5002-d125-4e54-897f-a76eab08f976 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:00.112493 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-759b5002-d125-4e54-897f-a76eab08f976 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:00.262551 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-759b5002-d125-4e54-897f-a76eab08f976 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:08:00.270727 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-759b5002-d125-4e54-897f-a76eab08f976 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1451 microversion: 2.1 time: 0.173138 Sep 01 15:08:00.271241 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 493/986] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:00 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:08:00.291154 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-49bdf2cc-8d67-4c90-bfe5-485cd03c3c6b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:00.291816 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-49bdf2cc-8d67-4c90-bfe5-485cd03c3c6b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:00.299336 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-49bdf2cc-8d67-4c90-bfe5-485cd03c3c6b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:00.299830 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-49bdf2cc-8d67-4c90-bfe5-485cd03c3c6b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:00.300271 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-49bdf2cc-8d67-4c90-bfe5-485cd03c3c6b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:00.301085 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-49bdf2cc-8d67-4c90-bfe5-485cd03c3c6b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:00.301541 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-49bdf2cc-8d67-4c90-bfe5-485cd03c3c6b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:00.302004 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-49bdf2cc-8d67-4c90-bfe5-485cd03c3c6b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:00.528632 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-49bdf2cc-8d67-4c90-bfe5-485cd03c3c6b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:08:00.539754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-49bdf2cc-8d67-4c90-bfe5-485cd03c3c6b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1451 microversion: 2.1 time: 0.252356 Sep 01 15:08:00.540315 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 494/987] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:00 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1451 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:08:00.852033 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-c4c654d8-7b37-4178-85b2-f86dd67cfeda tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:00.852540 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c4c654d8-7b37-4178-85b2-f86dd67cfeda tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:00.854796 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-8c1f7e3c-f6b8-42bb-92b2-3e0a4be2de21 req-7c7829b8-c677-4ac6-b2f8-9b3bccf9817a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a", "tag": "ee2ec77e-7de7-43b9-b302-bffde8d5f382"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:08:00.865248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-8c1f7e3c-f6b8-42bb-92b2-3e0a4be2de21 req-7c7829b8-c677-4ac6-b2f8-9b3bccf9817a service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:00.865579 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4c654d8-7b37-4178-85b2-f86dd67cfeda tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:00.866037 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-8c1f7e3c-f6b8-42bb-92b2-3e0a4be2de21 req-7c7829b8-c677-4ac6-b2f8-9b3bccf9817a service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:00.866348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4c654d8-7b37-4178-85b2-f86dd67cfeda tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:00.866717 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-8c1f7e3c-f6b8-42bb-92b2-3e0a4be2de21 req-7c7829b8-c677-4ac6-b2f8-9b3bccf9817a service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:00.866855 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4c654d8-7b37-4178-85b2-f86dd67cfeda tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:00.867514 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4c654d8-7b37-4178-85b2-f86dd67cfeda tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:00.868146 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4c654d8-7b37-4178-85b2-f86dd67cfeda tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:00.868576 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-c4c654d8-7b37-4178-85b2-f86dd67cfeda tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:00.878941 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-8c1f7e3c-f6b8-42bb-92b2-3e0a4be2de21 req-7c7829b8-c677-4ac6-b2f8-9b3bccf9817a service nova] Creating event network-changed:ee2ec77e-7de7-43b9-b302-bffde8d5f382 for instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a on hv-cinder-85505 Sep 01 15:08:00.884325 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-8c1f7e3c-f6b8-42bb-92b2-3e0a4be2de21 req-7c7829b8-c677-4ac6-b2f8-9b3bccf9817a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033693 Sep 01 15:08:00.885626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 495/988] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:08:00.912255 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-c4c654d8-7b37-4178-85b2-f86dd67cfeda tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Going to try to terminate instance {{(pid=120553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:08:01.030972 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-c4c654d8-7b37-4178-85b2-f86dd67cfeda tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 204 len: 0 microversion: 2.1 time: 0.182555 Sep 01 15:08:01.031767 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 494/989] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:08:00 2022] DELETE /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:08:01.040352 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0ed717eb-dd28-4d73-8977-347fa91e17ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:01.041236 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-0ed717eb-dd28-4d73-8977-347fa91e17ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:01.048851 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0ed717eb-dd28-4d73-8977-347fa91e17ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:01.049359 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0ed717eb-dd28-4d73-8977-347fa91e17ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:01.049972 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0ed717eb-dd28-4d73-8977-347fa91e17ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:01.050554 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0ed717eb-dd28-4d73-8977-347fa91e17ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:01.051164 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0ed717eb-dd28-4d73-8977-347fa91e17ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:01.051602 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-0ed717eb-dd28-4d73-8977-347fa91e17ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:01.211789 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-0ed717eb-dd28-4d73-8977-347fa91e17ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:08:01.224530 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0ed717eb-dd28-4d73-8977-347fa91e17ce tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.187917 Sep 01 15:08:01.235992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 496/990] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:01 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:08:02.247172 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-bcc13cc2-f6e2-4bd1-aae3-aa391a499841 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:02.248182 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-bcc13cc2-f6e2-4bd1-aae3-aa391a499841 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:02.254813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bcc13cc2-f6e2-4bd1-aae3-aa391a499841 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:02.255358 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bcc13cc2-f6e2-4bd1-aae3-aa391a499841 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:02.255815 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bcc13cc2-f6e2-4bd1-aae3-aa391a499841 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:02.256600 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bcc13cc2-f6e2-4bd1-aae3-aa391a499841 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:02.257142 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bcc13cc2-f6e2-4bd1-aae3-aa391a499841 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:02.257576 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-bcc13cc2-f6e2-4bd1-aae3-aa391a499841 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:02.279676 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:08:02.551836 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-bcc13cc2-f6e2-4bd1-aae3-aa391a499841 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:08:02.559698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-bcc13cc2-f6e2-4bd1-aae3-aa391a499841 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1568 microversion: 2.1 time: 0.317494 Sep 01 15:08:02.561094 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 495/991] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:02 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1568 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:08:03.306733 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-93182c0d-80e9-4b2e-b837-40bf26f27b71 req-a00592e1-2534-462b-b270-9b1406c12554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be64d588-2a22-4c84-b763-dbd89e476a69", "tag": "4ae7b8f7-3330-4928-b35e-6143ba6cd144"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:08:03.317332 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-93182c0d-80e9-4b2e-b837-40bf26f27b71 req-a00592e1-2534-462b-b270-9b1406c12554 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:03.317592 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-93182c0d-80e9-4b2e-b837-40bf26f27b71 req-a00592e1-2534-462b-b270-9b1406c12554 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:03.318359 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-93182c0d-80e9-4b2e-b837-40bf26f27b71 req-a00592e1-2534-462b-b270-9b1406c12554 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:03.331295 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-93182c0d-80e9-4b2e-b837-40bf26f27b71 req-a00592e1-2534-462b-b270-9b1406c12554 service nova] Creating event network-changed:4ae7b8f7-3330-4928-b35e-6143ba6cd144 for instance be64d588-2a22-4c84-b763-dbd89e476a69 on hv-cinder-85505 Sep 01 15:08:03.336736 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-93182c0d-80e9-4b2e-b837-40bf26f27b71 req-a00592e1-2534-462b-b270-9b1406c12554 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034102 Sep 01 15:08:03.337349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 497/992] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:08:03.581865 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-75fbad5e-eb03-427f-8933-4f8b7218ff30 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:03.582519 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-75fbad5e-eb03-427f-8933-4f8b7218ff30 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:03.592860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-75fbad5e-eb03-427f-8933-4f8b7218ff30 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:03.593371 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-75fbad5e-eb03-427f-8933-4f8b7218ff30 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:03.594195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-75fbad5e-eb03-427f-8933-4f8b7218ff30 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:03.595340 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-75fbad5e-eb03-427f-8933-4f8b7218ff30 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:03.596100 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-75fbad5e-eb03-427f-8933-4f8b7218ff30 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:03.596537 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-75fbad5e-eb03-427f-8933-4f8b7218ff30 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:03.712281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-75fbad5e-eb03-427f-8933-4f8b7218ff30 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '210bc3fc36724b32ba50364332c6f900', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764329f7a06b42969616baffd95cbd29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:08:03.721588 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-75fbad5e-eb03-427f-8933-4f8b7218ff30 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 200 len: 1219 microversion: 2.1 time: 0.143559 Sep 01 15:08:03.722558 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 496/993] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:03 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:08:04.744154 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:04.744870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] [instance: d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:04.751870 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:04.752299 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:04.752739 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:04.753577 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:04.754274 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:04.754823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:04.768379 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] HTTP exception thrown: Instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a could not be found. Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Request method failure captured: Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a HTTP/1.1 Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMm_XR0ZOHTfsbAPMdjj9wwBzaTQ_-sJXdcrqzMLRbhiziZIj_uWId9oq1iYYRPxO0D5hM0R_fLAieRT-ZetUQtBzofDPf8nbvfDAb2LzuDtEPPjnQRfUbV1NNkmZGpqvS7AuCJ-HEpWgiN2Zio6Z_Uq1tArQszEtOFTuWJXC5pNEiE Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 764329f7a06b42969616baffd95cbd29 Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-TestShelveInstance-268439396 Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:08:04.770013 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/764329f7a06b42969616baffd95cbd29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764329f7a06b42969616baffd95cbd29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_764329f7a06b42969616baffd95cbd29", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/764329f7a06b42969616baffd95cbd29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-TestShelveInstance-268439396 Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 764329f7a06b42969616baffd95cbd29 Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-TestShelveInstance-268439396 Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-TestShelveInstance-268439396-project Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 210bc3fc36724b32ba50364332c6f900 Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-TestShelveInstance-268439396-project Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a could not be found. Sep 01 15:08:04.771867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': 'd67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a'} Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a could not be found. Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:04.772884 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a could not be found. Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a could not be found. Sep 01 15:08:04.774586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:04.776166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Returning 404 to user: Instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:04.776166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6f1fd100-eb6d-477f-a1b2-322a45b0d365 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a" status: 404 len: 111 microversion: 2.1 time: 0.031814 Sep 01 15:08:04.776166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 498/994] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:04 2022] GET /compute/v2.1/servers/d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:08:04.931340 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e31234d9-22f9-4f19-8151-641b030e4fb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] Calling method '.version_select at 0x7fab73cb88b0>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:04.958195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e31234d9-22f9-4f19-8151-641b030e4fb8 tempest-TestShelveInstance-268439396 tempest-TestShelveInstance-268439396-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1044275487" status: 202 len: 0 microversion: 2.1 time: 0.028869 Sep 01 15:08:04.958902 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 497/995] 10.222.0.33 () {58 vars in 1254 bytes} [Thu Sep 1 15:08:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1044275487 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:08:05.359308 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-e28bbfc0-19e9-4b98-b3d6-230bdd54ce2a req-d969d5f5-4631-4eac-b07c-d56e5eed60b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a", "name": "network-vif-deleted", "tag": "ee2ec77e-7de7-43b9-b302-bffde8d5f382"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:08:05.368938 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-e28bbfc0-19e9-4b98-b3d6-230bdd54ce2a req-d969d5f5-4631-4eac-b07c-d56e5eed60b0 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:05.369420 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-e28bbfc0-19e9-4b98-b3d6-230bdd54ce2a req-d969d5f5-4631-4eac-b07c-d56e5eed60b0 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:05.369858 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-e28bbfc0-19e9-4b98-b3d6-230bdd54ce2a req-d969d5f5-4631-4eac-b07c-d56e5eed60b0 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:05.381345 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-e28bbfc0-19e9-4b98-b3d6-230bdd54ce2a req-d969d5f5-4631-4eac-b07c-d56e5eed60b0 service nova] Creating event network-vif-deleted:ee2ec77e-7de7-43b9-b302-bffde8d5f382 for instance d67d4f44-8541-4ad9-aa7f-c74f0a9d5f8a on hv-cinder-85505 Sep 01 15:08:05.386339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-e28bbfc0-19e9-4b98-b3d6-230bdd54ce2a req-d969d5f5-4631-4eac-b07c-d56e5eed60b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030743 Sep 01 15:08:05.386929 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 499/996] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:08:31.280510 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=8 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:08:31.281332 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:08:31.285926 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-79fe27ae-cbfa-44af-8f2f-76fc25ebecbc tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1294547924"}} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:08:31.286668 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-79fe27ae-cbfa-44af-8f2f-76fc25ebecbc tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:31.294067 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79fe27ae-cbfa-44af-8f2f-76fc25ebecbc tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:31.294681 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79fe27ae-cbfa-44af-8f2f-76fc25ebecbc tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:31.295121 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79fe27ae-cbfa-44af-8f2f-76fc25ebecbc tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:31.295815 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79fe27ae-cbfa-44af-8f2f-76fc25ebecbc tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:31.296298 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79fe27ae-cbfa-44af-8f2f-76fc25ebecbc tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:31.296727 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79fe27ae-cbfa-44af-8f2f-76fc25ebecbc tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:31.648998 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.network.security_group_api [None req-79fe27ae-cbfa-44af-8f2f-76fc25ebecbc tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Removing security group 297e84e3-c75d-4368-96fe-4f1f18ae126a from port b955ae31-2f13-44ac-bf18-3538dbd1b0ea Sep 01 15:08:31.961629 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-79fe27ae-cbfa-44af-8f2f-76fc25ebecbc tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "POST /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/action" status: 202 len: 0 microversion: 2.1 time: 0.682613 Sep 01 15:08:31.965721 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 498/997] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 1 15:08:31 2022] POST /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:08:31.970732 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=19 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:08:31.972755 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=90 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:08:31.977222 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-52ab6870-c3a2-4329-a4c3-bb88417200e2 req-39fd2ef3-1ed8-4a04-8e68-8c6a274ba58a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bf9afc-7517-4bc5-9f4b-0b9cff1b186c", "tag": "b955ae31-2f13-44ac-bf18-3538dbd1b0ea"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:08:31.989335 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-52ab6870-c3a2-4329-a4c3-bb88417200e2 req-39fd2ef3-1ed8-4a04-8e68-8c6a274ba58a service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:31.989823 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-52ab6870-c3a2-4329-a4c3-bb88417200e2 req-39fd2ef3-1ed8-4a04-8e68-8c6a274ba58a service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:31.990277 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-52ab6870-c3a2-4329-a4c3-bb88417200e2 req-39fd2ef3-1ed8-4a04-8e68-8c6a274ba58a service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:32.004090 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-52ab6870-c3a2-4329-a4c3-bb88417200e2 req-39fd2ef3-1ed8-4a04-8e68-8c6a274ba58a service nova] Creating event network-changed:b955ae31-2f13-44ac-bf18-3538dbd1b0ea for instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c on hv-cinder-85505 Sep 01 15:08:32.009635 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-52ab6870-c3a2-4329-a4c3-bb88417200e2 req-39fd2ef3-1ed8-4a04-8e68-8c6a274ba58a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040324 Sep 01 15:08:32.010569 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 500/998] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:08:33.422451 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a939b24b-8aba-4921-a8bf-d309643dc523 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:33.428807 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-72d5fb9b-8bff-493e-9538-5e122f25a397 req-a532216c-884d-4953-b559-5fc19dfac23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85bf9afc-7517-4bc5-9f4b-0b9cff1b186c", "tag": "b955ae31-2f13-44ac-bf18-3538dbd1b0ea"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:08:33.429350 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a939b24b-8aba-4921-a8bf-d309643dc523 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:33.437367 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a939b24b-8aba-4921-a8bf-d309643dc523 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:33.437856 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a939b24b-8aba-4921-a8bf-d309643dc523 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:33.438424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a939b24b-8aba-4921-a8bf-d309643dc523 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:33.439231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a939b24b-8aba-4921-a8bf-d309643dc523 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:33.439915 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a939b24b-8aba-4921-a8bf-d309643dc523 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:33.440277 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a939b24b-8aba-4921-a8bf-d309643dc523 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:33.443168 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-72d5fb9b-8bff-493e-9538-5e122f25a397 req-a532216c-884d-4953-b559-5fc19dfac23c service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:33.443718 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-72d5fb9b-8bff-493e-9538-5e122f25a397 req-a532216c-884d-4953-b559-5fc19dfac23c service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:33.444221 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-72d5fb9b-8bff-493e-9538-5e122f25a397 req-a532216c-884d-4953-b559-5fc19dfac23c service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:33.456537 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-72d5fb9b-8bff-493e-9538-5e122f25a397 req-a532216c-884d-4953-b559-5fc19dfac23c service nova] Creating event network-changed:b955ae31-2f13-44ac-bf18-3538dbd1b0ea for instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c on hv-cinder-85505 Sep 01 15:08:33.461450 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-72d5fb9b-8bff-493e-9538-5e122f25a397 req-a532216c-884d-4953-b559-5fc19dfac23c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037075 Sep 01 15:08:33.462263 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 501/999] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:08:33.544788 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-a939b24b-8aba-4921-a8bf-d309643dc523 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lazy-loading 'services' on Instance uuid 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:08:33.638699 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a939b24b-8aba-4921-a8bf-d309643dc523 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/os-volume_attachments/7ee87cc3-c7ca-44a8-a7b6-62206662d949" status: 202 len: 0 microversion: 2.1 time: 0.219988 Sep 01 15:08:33.639305 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 499/1000] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:08:33 2022] DELETE /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/os-volume_attachments/7ee87cc3-c7ca-44a8-a7b6-62206662d949 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:08:33.658725 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-70c10039-14e0-4ff3-9d5f-8b8019316aa3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:33.662077 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-70c10039-14e0-4ff3-9d5f-8b8019316aa3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:33.671916 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70c10039-14e0-4ff3-9d5f-8b8019316aa3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:33.674882 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70c10039-14e0-4ff3-9d5f-8b8019316aa3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:33.675417 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70c10039-14e0-4ff3-9d5f-8b8019316aa3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:33.676254 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70c10039-14e0-4ff3-9d5f-8b8019316aa3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:33.676797 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70c10039-14e0-4ff3-9d5f-8b8019316aa3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:33.677307 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-70c10039-14e0-4ff3-9d5f-8b8019316aa3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:33.728628 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-70c10039-14e0-4ff3-9d5f-8b8019316aa3 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082481 Sep 01 15:08:33.733891 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 502/1001] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:08:33 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:08:34.742845 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-168c4089-63c6-44fa-a63a-b8b7866b7c35 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:34.745197 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-168c4089-63c6-44fa-a63a-b8b7866b7c35 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:34.752201 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-168c4089-63c6-44fa-a63a-b8b7866b7c35 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:34.752699 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-168c4089-63c6-44fa-a63a-b8b7866b7c35 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:34.753142 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-168c4089-63c6-44fa-a63a-b8b7866b7c35 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:34.753860 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-168c4089-63c6-44fa-a63a-b8b7866b7c35 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:34.754361 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-168c4089-63c6-44fa-a63a-b8b7866b7c35 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:34.754798 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-168c4089-63c6-44fa-a63a-b8b7866b7c35 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:34.784833 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-168c4089-63c6-44fa-a63a-b8b7866b7c35 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046856 Sep 01 15:08:34.785398 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 500/1002] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:08:34 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 15:08:34.796612 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-03cbcfaf-4603-4004-ad83-d371f1426423 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:34.797188 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:34.797319 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-03cbcfaf-4603-4004-ad83-d371f1426423 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:34.797435 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:34.803371 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:34.803564 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03cbcfaf-4603-4004-ad83-d371f1426423 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:34.804010 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:34.804157 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03cbcfaf-4603-4004-ad83-d371f1426423 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:34.804451 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:34.804556 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03cbcfaf-4603-4004-ad83-d371f1426423 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:34.805148 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:34.805269 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03cbcfaf-4603-4004-ad83-d371f1426423 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:34.805605 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:34.805707 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03cbcfaf-4603-4004-ad83-d371f1426423 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:34.806029 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-03cbcfaf-4603-4004-ad83-d371f1426423 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:34.806152 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:34.832455 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-03cbcfaf-4603-4004-ad83-d371f1426423 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/ips" status: 200 len: 149 microversion: 2.1 time: 0.040225 Sep 01 15:08:34.833036 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 503/1003] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 1 15:08:34 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:08:34.891228 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] HTTP exception thrown: Instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c is not attached to volume 7ee87cc3-c7ca-44a8-a7b6-62206662d949 Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Request method failure captured: Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: DELETE /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/os-volume_attachments/7ee87cc3-c7ca-44a8-a7b6-62206662d949 HTTP/1.1 Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMptazIeKcll8HK_Fc9kS3d5h5LidOvHEprMJNDH-6lcb1Ry63E3n2GwhY_1SAvYHAPDbQiGJebKeh1iC18_v4IjWiF7RBgpdzyyB9uJTP1mu-ZLNxs3Gks0No9ipNFZmx10x0ctnygdzauBsbhf9hnIuIJHxziSSIxhNSXrb9hnMTU Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: a7311840457040a992b3bebaa2d32843 Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-TestMinimumBasicScenario-979437426 Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:08:34.894550 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:08:34.896427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7311840457040a992b3bebaa2d32843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7311840457040a992b3bebaa2d32843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7311840457040a992b3bebaa2d32843", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7311840457040a992b3bebaa2d32843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:34.896427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-TestMinimumBasicScenario-979437426 Sep 01 15:08:34.896427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: a7311840457040a992b3bebaa2d32843 Sep 01 15:08:34.896427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-TestMinimumBasicScenario-979437426 Sep 01 15:08:34.896427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-TestMinimumBasicScenario-979437426-project Sep 01 15:08:34.896427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:08:34.896427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:08:34.896427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 70cd6c18012049419d7fa7b591b4bd28 Sep 01 15:08:34.896427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-TestMinimumBasicScenario-979437426-project Sep 01 15:08:34.896427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:08:34.896427 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c is not attached to volume 7ee87cc3-c7ca-44a8-a7b6-62206662d949 Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'server_id': '85bf9afc-7517-4bc5-9f4b-0b9cff1b186c', 'id': '7ee87cc3-c7ca-44a8-a7b6-62206662d949'} Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7ee87cc3-c7ca-44a8-a7b6-62206662d949. Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:34.897337 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c is not attached to volume 7ee87cc3-c7ca-44a8-a7b6-62206662d949 Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c is not attached to volume 7ee87cc3-c7ca-44a8-a7b6-62206662d949 Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:34.898978 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Returning 404 to user: Instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c is not attached to volume 7ee87cc3-c7ca-44a8-a7b6-62206662d949 {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:34.900569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6e33bc20-46f3-4572-b2ca-5409d4913d86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/os-volume_attachments/7ee87cc3-c7ca-44a8-a7b6-62206662d949" status: 404 len: 154 microversion: 2.1 time: 0.104137 Sep 01 15:08:34.900569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 501/1004] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:08:34 2022] DELETE /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c/os-volume_attachments/7ee87cc3-c7ca-44a8-a7b6-62206662d949 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 15:08:36.046339 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6f373030-784e-4084-9709-425810f937d8 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:36.046835 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6f373030-784e-4084-9709-425810f937d8 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:36.053121 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f373030-784e-4084-9709-425810f937d8 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:36.053608 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f373030-784e-4084-9709-425810f937d8 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:36.054043 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f373030-784e-4084-9709-425810f937d8 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:36.054766 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f373030-784e-4084-9709-425810f937d8 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:36.055230 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f373030-784e-4084-9709-425810f937d8 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:36.055657 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6f373030-784e-4084-9709-425810f937d8 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:36.081665 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6f373030-784e-4084-9709-425810f937d8 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:08:36.157465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6f373030-784e-4084-9709-425810f937d8 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 204 len: 0 microversion: 2.1 time: 0.115501 Sep 01 15:08:36.158202 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 504/1005] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:08:36 2022] DELETE /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:08:36.166677 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d5b21d6f-2393-443b-b14e-beb92fa7aa68 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:36.167551 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d5b21d6f-2393-443b-b14e-beb92fa7aa68 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:36.176905 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d5b21d6f-2393-443b-b14e-beb92fa7aa68 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:36.177591 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d5b21d6f-2393-443b-b14e-beb92fa7aa68 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:36.178108 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d5b21d6f-2393-443b-b14e-beb92fa7aa68 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:36.178928 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d5b21d6f-2393-443b-b14e-beb92fa7aa68 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:36.179416 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d5b21d6f-2393-443b-b14e-beb92fa7aa68 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:36.179850 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-d5b21d6f-2393-443b-b14e-beb92fa7aa68 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:36.208266 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-54881fb0-a8ce-41ca-8997-a1143afecd4d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32e490a1-5bdc-4314-affa-3ebf030a31c1"}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:08:36.210666 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-54881fb0-a8ce-41ca-8997-a1143afecd4d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:36.217106 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-54881fb0-a8ce-41ca-8997-a1143afecd4d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:36.217593 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-54881fb0-a8ce-41ca-8997-a1143afecd4d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:36.218032 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-54881fb0-a8ce-41ca-8997-a1143afecd4d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:36.218792 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-54881fb0-a8ce-41ca-8997-a1143afecd4d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:36.219247 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-54881fb0-a8ce-41ca-8997-a1143afecd4d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:36.219675 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-54881fb0-a8ce-41ca-8997-a1143afecd4d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:36.318225 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d5b21d6f-2393-443b-b14e-beb92fa7aa68 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:08:36.326446 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d5b21d6f-2393-443b-b14e-beb92fa7aa68 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1554 microversion: 2.1 time: 0.163759 Sep 01 15:08:36.327084 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 502/1006] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:36 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:08:37.347755 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2d04007f-47ac-48dd-bfe0-d41fa9fc6e86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:37.348431 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2d04007f-47ac-48dd-bfe0-d41fa9fc6e86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:37.354826 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d04007f-47ac-48dd-bfe0-d41fa9fc6e86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:37.355311 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d04007f-47ac-48dd-bfe0-d41fa9fc6e86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:37.355749 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d04007f-47ac-48dd-bfe0-d41fa9fc6e86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:37.356436 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d04007f-47ac-48dd-bfe0-d41fa9fc6e86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:37.357505 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d04007f-47ac-48dd-bfe0-d41fa9fc6e86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:37.357980 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2d04007f-47ac-48dd-bfe0-d41fa9fc6e86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:37.488161 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2d04007f-47ac-48dd-bfe0-d41fa9fc6e86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:08:37.495877 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2d04007f-47ac-48dd-bfe0-d41fa9fc6e86 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1554 microversion: 2.1 time: 0.152281 Sep 01 15:08:37.496435 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 503/1007] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:37 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:08:37.867700 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-54881fb0-a8ce-41ca-8997-a1143afecd4d tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "POST /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.663439 Sep 01 15:08:37.868350 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 505/1008] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 1 15:08:36 2022] POST /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/os-volume_attachments => generated 194 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:08:38.492199 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-639bc05b-2990-4f72-b0b2-291841f5b816 req-2882dea1-91a8-4ed5-b0df-ae2b3b04ae81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85bf9afc-7517-4bc5-9f4b-0b9cff1b186c", "name": "network-vif-deleted", "tag": "b955ae31-2f13-44ac-bf18-3538dbd1b0ea"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:08:38.507715 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-639bc05b-2990-4f72-b0b2-291841f5b816 req-2882dea1-91a8-4ed5-b0df-ae2b3b04ae81 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:38.507715 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-639bc05b-2990-4f72-b0b2-291841f5b816 req-2882dea1-91a8-4ed5-b0df-ae2b3b04ae81 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:38.507715 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-639bc05b-2990-4f72-b0b2-291841f5b816 req-2882dea1-91a8-4ed5-b0df-ae2b3b04ae81 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:38.517924 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-60a8e599-2df9-4503-817a-0c75f5d06990 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:38.518677 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-60a8e599-2df9-4503-817a-0c75f5d06990 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:38.519520 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-639bc05b-2990-4f72-b0b2-291841f5b816 req-2882dea1-91a8-4ed5-b0df-ae2b3b04ae81 service nova] Creating event network-vif-deleted:b955ae31-2f13-44ac-bf18-3538dbd1b0ea for instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c on hv-cinder-85505 Sep 01 15:08:38.524257 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-639bc05b-2990-4f72-b0b2-291841f5b816 req-2882dea1-91a8-4ed5-b0df-ae2b3b04ae81 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036073 Sep 01 15:08:38.524870 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 504/1009] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:08:38.533436 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-60a8e599-2df9-4503-817a-0c75f5d06990 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:38.533932 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-60a8e599-2df9-4503-817a-0c75f5d06990 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:38.534407 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-60a8e599-2df9-4503-817a-0c75f5d06990 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:38.535112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-60a8e599-2df9-4503-817a-0c75f5d06990 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:38.535565 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-60a8e599-2df9-4503-817a-0c75f5d06990 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:38.535987 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-60a8e599-2df9-4503-817a-0c75f5d06990 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:38.609576 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-60a8e599-2df9-4503-817a-0c75f5d06990 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cd6c18012049419d7fa7b591b4bd28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7311840457040a992b3bebaa2d32843', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:08:38.617443 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-60a8e599-2df9-4503-817a-0c75f5d06990 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 200 len: 1344 microversion: 2.1 time: 0.104178 Sep 01 15:08:38.618095 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 506/1010] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:38 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 1344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:08:39.639489 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:39.640188 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] [instance: 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:39.646592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:39.647085 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:39.647523 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:39.648217 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:39.648669 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:39.649091 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:39.662717 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] HTTP exception thrown: Instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c could not be found. Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Request method failure captured: Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c HTTP/1.1 Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMptazIeKcll8HK_Fc9kS3d5h5LidOvHEprMJNDH-6lcb1Ry63E3n2GwhY_1SAvYHAPDbQiGJebKeh1iC18_v4IjWiF7RBgpdzyyB9uJTP1mu-ZLNxs3Gks0No9ipNFZmx10x0ctnygdzauBsbhf9hnIuIJHxziSSIxhNSXrb9hnMTU Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: a7311840457040a992b3bebaa2d32843 Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-TestMinimumBasicScenario-979437426 Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:08:39.664359 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7311840457040a992b3bebaa2d32843"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7311840457040a992b3bebaa2d32843"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7311840457040a992b3bebaa2d32843", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7311840457040a992b3bebaa2d32843"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-TestMinimumBasicScenario-979437426 Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: a7311840457040a992b3bebaa2d32843 Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-TestMinimumBasicScenario-979437426 Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-TestMinimumBasicScenario-979437426-project Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 70cd6c18012049419d7fa7b591b4bd28 Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-TestMinimumBasicScenario-979437426-project Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c could not be found. Sep 01 15:08:39.666048 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '85bf9afc-7517-4bc5-9f4b-0b9cff1b186c'} Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c could not be found. Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:39.667227 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c could not be found. Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c could not be found. Sep 01 15:08:39.669572 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:39.671176 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Returning 404 to user: Instance 85bf9afc-7517-4bc5-9f4b-0b9cff1b186c could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:39.671176 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-6f3eb191-8728-4986-8986-a783badf2341 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c" status: 404 len: 111 microversion: 2.1 time: 0.030944 Sep 01 15:08:39.671176 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 505/1011] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:39 2022] GET /compute/v2.1/servers/85bf9afc-7517-4bc5-9f4b-0b9cff1b186c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:08:39.675024 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d78fa989-b16d-4c89-9dd4-56c281362a04 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] Calling method '.version_select at 0x7fab73ea5a60>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:39.694874 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d78fa989-b16d-4c89-9dd4-56c281362a04 tempest-TestMinimumBasicScenario-979437426 tempest-TestMinimumBasicScenario-979437426-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1161831181" status: 202 len: 0 microversion: 2.1 time: 0.023466 Sep 01 15:08:39.695711 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 507/1012] 10.222.0.33 () {58 vars in 1272 bytes} [Thu Sep 1 15:08:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1161831181 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:08:44.523256 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-22253149-d5c9-4a1a-a25d-2aba62e835ca tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:44.523859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-22253149-d5c9-4a1a-a25d-2aba62e835ca tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:44.530452 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22253149-d5c9-4a1a-a25d-2aba62e835ca tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:44.530945 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22253149-d5c9-4a1a-a25d-2aba62e835ca tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:44.531500 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22253149-d5c9-4a1a-a25d-2aba62e835ca tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:44.532174 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22253149-d5c9-4a1a-a25d-2aba62e835ca tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:44.532634 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22253149-d5c9-4a1a-a25d-2aba62e835ca tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:44.533066 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-22253149-d5c9-4a1a-a25d-2aba62e835ca tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:44.631284 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.objects.instance [None req-22253149-d5c9-4a1a-a25d-2aba62e835ca tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lazy-loading 'services' on Instance uuid 0c11ebba-4f71-4422-a5f2-4688b22ed58c {{(pid=120553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:08:44.740140 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-22253149-d5c9-4a1a-a25d-2aba62e835ca tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/os-volume_attachments/32e490a1-5bdc-4314-affa-3ebf030a31c1" status: 202 len: 0 microversion: 2.1 time: 0.220641 Sep 01 15:08:44.742304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 506/1013] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 1 15:08:44 2022] DELETE /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/os-volume_attachments/32e490a1-5bdc-4314-affa-3ebf030a31c1 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:08:44.757374 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-6cdadefb-59a1-4c44-a559-ab8d933cc170 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:44.759626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-6cdadefb-59a1-4c44-a559-ab8d933cc170 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:44.787635 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6cdadefb-59a1-4c44-a559-ab8d933cc170 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:44.788229 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6cdadefb-59a1-4c44-a559-ab8d933cc170 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:44.788680 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6cdadefb-59a1-4c44-a559-ab8d933cc170 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:44.789424 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6cdadefb-59a1-4c44-a559-ab8d933cc170 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:44.789894 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6cdadefb-59a1-4c44-a559-ab8d933cc170 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:44.790361 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-6cdadefb-59a1-4c44-a559-ab8d933cc170 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:44.830874 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-6cdadefb-59a1-4c44-a559-ab8d933cc170 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085242 Sep 01 15:08:44.837239 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 508/1014] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:08:44 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:08:45.846387 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-425271be-d15f-465f-a447-c28b5ad04fe3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:45.848874 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-425271be-d15f-465f-a447-c28b5ad04fe3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:45.855265 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-425271be-d15f-465f-a447-c28b5ad04fe3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:45.855756 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-425271be-d15f-465f-a447-c28b5ad04fe3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:45.856192 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-425271be-d15f-465f-a447-c28b5ad04fe3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:45.861238 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-425271be-d15f-465f-a447-c28b5ad04fe3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:45.861238 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-425271be-d15f-465f-a447-c28b5ad04fe3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:45.861238 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-425271be-d15f-465f-a447-c28b5ad04fe3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:45.889587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-425271be-d15f-465f-a447-c28b5ad04fe3 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048094 Sep 01 15:08:45.890164 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 507/1015] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 1 15:08:45 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 15:08:45.953867 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ab056e03-d9a1-40b5-9af2-4e80cbe010d7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:45.954470 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ab056e03-d9a1-40b5-9af2-4e80cbe010d7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:45.960908 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab056e03-d9a1-40b5-9af2-4e80cbe010d7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:45.961394 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab056e03-d9a1-40b5-9af2-4e80cbe010d7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:45.961830 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab056e03-d9a1-40b5-9af2-4e80cbe010d7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:45.962581 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab056e03-d9a1-40b5-9af2-4e80cbe010d7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:45.963038 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab056e03-d9a1-40b5-9af2-4e80cbe010d7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:45.963474 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ab056e03-d9a1-40b5-9af2-4e80cbe010d7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:45.990276 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ab056e03-d9a1-40b5-9af2-4e80cbe010d7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:08:46.079484 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ab056e03-d9a1-40b5-9af2-4e80cbe010d7 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 204 len: 0 microversion: 2.1 time: 0.128963 Sep 01 15:08:46.080893 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 509/1016] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:08:45 2022] DELETE /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:08:46.089233 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b4fbead3-e0db-46b4-8a39-0de35847c13f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:46.090317 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b4fbead3-e0db-46b4-8a39-0de35847c13f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:46.096939 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b4fbead3-e0db-46b4-8a39-0de35847c13f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:46.097322 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b4fbead3-e0db-46b4-8a39-0de35847c13f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:46.098157 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b4fbead3-e0db-46b4-8a39-0de35847c13f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:46.098921 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b4fbead3-e0db-46b4-8a39-0de35847c13f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:46.099895 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b4fbead3-e0db-46b4-8a39-0de35847c13f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:46.100323 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b4fbead3-e0db-46b4-8a39-0de35847c13f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:46.260386 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b4fbead3-e0db-46b4-8a39-0de35847c13f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:08:46.279598 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b4fbead3-e0db-46b4-8a39-0de35847c13f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1680 microversion: 2.1 time: 0.194292 Sep 01 15:08:46.286283 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 508/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:46 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:08:47.301891 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2ca34079-fc60-4f01-9a29-8c652614f810 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:47.302716 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2ca34079-fc60-4f01-9a29-8c652614f810 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:47.309791 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2ca34079-fc60-4f01-9a29-8c652614f810 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:47.310404 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2ca34079-fc60-4f01-9a29-8c652614f810 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:47.310851 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2ca34079-fc60-4f01-9a29-8c652614f810 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:47.311559 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2ca34079-fc60-4f01-9a29-8c652614f810 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:47.312015 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2ca34079-fc60-4f01-9a29-8c652614f810 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:47.312440 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2ca34079-fc60-4f01-9a29-8c652614f810 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:47.452065 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2ca34079-fc60-4f01-9a29-8c652614f810 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:08:47.460542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2ca34079-fc60-4f01-9a29-8c652614f810 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1680 microversion: 2.1 time: 0.163106 Sep 01 15:08:47.461472 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 510/1018] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:47 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:08:48.469335 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-124e91e1-a2ff-4691-a5e9-e9f925d18817 req-bf1f0931-6bc3-4198-adb6-8994711f0201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c11ebba-4f71-4422-a5f2-4688b22ed58c", "name": "network-vif-deleted", "tag": "88ee1ffc-500b-42df-b198-183844a08775"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:08:48.482998 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3c9269f6-e838-460e-9bdd-c2aee802eecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:48.483623 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3c9269f6-e838-460e-9bdd-c2aee802eecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:48.493196 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-124e91e1-a2ff-4691-a5e9-e9f925d18817 req-bf1f0931-6bc3-4198-adb6-8994711f0201 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:48.495044 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c9269f6-e838-460e-9bdd-c2aee802eecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:48.495808 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-124e91e1-a2ff-4691-a5e9-e9f925d18817 req-bf1f0931-6bc3-4198-adb6-8994711f0201 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:48.496481 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c9269f6-e838-460e-9bdd-c2aee802eecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:48.497879 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c9269f6-e838-460e-9bdd-c2aee802eecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:48.498656 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-124e91e1-a2ff-4691-a5e9-e9f925d18817 req-bf1f0931-6bc3-4198-adb6-8994711f0201 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:48.499510 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c9269f6-e838-460e-9bdd-c2aee802eecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:48.499975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c9269f6-e838-460e-9bdd-c2aee802eecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:48.500403 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3c9269f6-e838-460e-9bdd-c2aee802eecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:48.522811 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-124e91e1-a2ff-4691-a5e9-e9f925d18817 req-bf1f0931-6bc3-4198-adb6-8994711f0201 service nova] Creating event network-vif-deleted:88ee1ffc-500b-42df-b198-183844a08775 for instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c on hv-cinder-85505 Sep 01 15:08:48.527819 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-124e91e1-a2ff-4691-a5e9-e9f925d18817 req-bf1f0931-6bc3-4198-adb6-8994711f0201 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062258 Sep 01 15:08:48.532680 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 509/1019] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:08:48.602074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-3c9269f6-e838-460e-9bdd-c2aee802eecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27653498cd0a4e089f1cbc43470182ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b789cb75bc24a898888246a7745537e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:08:48.614985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3c9269f6-e838-460e-9bdd-c2aee802eecb tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 200 len: 1612 microversion: 2.1 time: 0.136031 Sep 01 15:08:48.617397 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 511/1020] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:48 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 1612 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:08:49.640624 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:49.641370 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:49.649555 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:49.650147 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:49.650696 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:49.651548 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:49.652092 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:49.652737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:49.672776 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c HTTP/1.1 Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:08:49.674747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:49.676445 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '0c11ebba-4f71-4422-a5f2-4688b22ed58c'} Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:49.677439 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:49.679665 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:49.681444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:49.681444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-202cf4f5-64fd-41e3-87d6-926323f0f5f1 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 404 len: 111 microversion: 2.1 time: 0.041689 Sep 01 15:08:49.681444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 510/1021] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:49 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:08:49.689034 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-0d66b8e7-dafb-4694-871b-695fc9b81a56 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '.version_select at 0x7fab73f36700>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:49.706795 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-0d66b8e7-dafb-4694-871b-695fc9b81a56 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-565736365" status: 202 len: 0 microversion: 2.1 time: 0.022653 Sep 01 15:08:49.707375 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 512/1022] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Sep 1 15:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-565736365 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:08:51.463020 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:51.463549 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:51.470394 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:51.470876 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:51.471314 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:51.471999 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:51.472452 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:51.472870 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:51.486084 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: DELETE /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c HTTP/1.1 Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:08:51.487628 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:51.489308 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '0c11ebba-4f71-4422-a5f2-4688b22ed58c'} Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:51.490376 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:51.491965 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:51.493527 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:51.493527 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a949a5ef-f6c0-4928-bf6d-f5bc2b7a84af tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 404 len: 111 microversion: 2.1 time: 0.030009 Sep 01 15:08:51.493527 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 511/1023] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:08:51 2022] DELETE /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:08:51.498304 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:51.498921 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 0c11ebba-4f71-4422-a5f2-4688b22ed58c] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:51.505371 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:51.505859 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:51.506325 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:51.507014 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:51.507471 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:51.507898 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:51.521478 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c HTTP/1.1 Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:08:51.523116 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:51.524785 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '0c11ebba-4f71-4422-a5f2-4688b22ed58c'} Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:51.525770 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. Sep 01 15:08:51.527401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:51.529304 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance 0c11ebba-4f71-4422-a5f2-4688b22ed58c could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:51.529304 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-a6154c73-5898-43de-9992-0eaf71faec8c tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c" status: 404 len: 111 microversion: 2.1 time: 0.031023 Sep 01 15:08:51.529304 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 513/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:51 2022] GET /compute/v2.1/servers/0c11ebba-4f71-4422-a5f2-4688b22ed58c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:08:52.664265 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:52.664774 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:52.672117 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:52.672598 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:52.673032 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:52.673717 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:52.674173 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:52.674658 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:52.688340 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: DELETE /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 HTTP/1.1 Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:08:52.689854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:08:52.691528 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': 'b073e711-0ab9-4edf-a2c6-a469c4d32303'} Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:52.692569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:08:52.694119 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.695848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:52.695848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-79147257-b0c7-415c-9672-ded0983845c6 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 404 len: 111 microversion: 2.1 time: 0.030946 Sep 01 15:08:52.695848 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 512/1025] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:08:52 2022] DELETE /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:08:52.700985 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:52.701603 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: b073e711-0ab9-4edf-a2c6-a469c4d32303] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:52.708138 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:52.708622 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:52.709060 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:52.709745 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:52.710255 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:52.710683 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:52.724244 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 HTTP/1.1 Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:08:52.725730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:08:52.727475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': 'b073e711-0ab9-4edf-a2c6-a469c4d32303'} Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:52.728391 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. Sep 01 15:08:52.729918 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.731943 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance b073e711-0ab9-4edf-a2c6-a469c4d32303 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:52.731943 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-95ddd363-a2ab-476e-9da4-657fa13eea06 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303" status: 404 len: 111 microversion: 2.1 time: 0.029906 Sep 01 15:08:52.731943 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 514/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:52 2022] GET /compute/v2.1/servers/b073e711-0ab9-4edf-a2c6-a469c4d32303 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:08:52.736089 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:52.736587 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:52.742577 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:52.743061 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:52.743497 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:52.744177 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:52.744667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:52.745087 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:52.758468 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: DELETE /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 HTTP/1.1 Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:08:52.759973 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:08:52.761621 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '352d9545-b008-461c-b5ed-c95887f86e98'} Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:52.762664 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:08:52.764240 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.765940 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:52.765940 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-456751b5-6f97-4e7a-87be-566e47d1ef1a tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 404 len: 111 microversion: 2.1 time: 0.029732 Sep 01 15:08:52.765940 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 513/1027] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:08:52 2022] DELETE /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:08:52.769556 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:52.770166 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 352d9545-b008-461c-b5ed-c95887f86e98] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:52.776125 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:52.776618 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:52.777032 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:52.777707 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:52.778694 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:52.779118 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:52.792327 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 HTTP/1.1 Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:08:52.794465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:08:52.796124 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '352d9545-b008-461c-b5ed-c95887f86e98'} Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:52.797200 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. Sep 01 15:08:52.798777 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:52.800270 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance 352d9545-b008-461c-b5ed-c95887f86e98 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:52.800270 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-e951a2c5-c461-400b-9f0f-ac40c4c49d3f tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98" status: 404 len: 111 microversion: 2.1 time: 0.030292 Sep 01 15:08:52.800270 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 515/1028] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:52 2022] GET /compute/v2.1/servers/352d9545-b008-461c-b5ed-c95887f86e98 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:08:53.932609 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:53.933139 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:53.940095 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:53.940578 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:53.941012 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:53.941697 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:53.942150 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:53.942596 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:53.955889 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: DELETE /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 HTTP/1.1 Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:08:53.957422 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:08:53.959055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '550286be-d749-4dff-9def-2d2a3bb0a283'} Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:53.959906 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:08:53.961304 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:08:53.963164 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:53.963164 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ac0adabe-d040-4d8c-a067-92065e0a7168 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "DELETE /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 404 len: 111 microversion: 2.1 time: 0.030116 Sep 01 15:08:53.963164 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 514/1029] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:08:53 2022] DELETE /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:08:53.967219 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:08:53.967840 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] [instance: 550286be-d749-4dff-9def-2d2a3bb0a283] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:08:53.974311 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:53.974797 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:53.975238 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:53.975938 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:08:53.976403 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:08:53.976834 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:08:53.990690 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] HTTP exception thrown: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Request method failure captured: Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 HTTP/1.1 Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMnnmPIv5WaoDAoM8ras2gKWBkuULfdNy55OLuGgbOqHU8ymeiRM9b5kTOsH2uURzn0b58YGWalxbUJ7bMvN3rbSkL39bBVlPBC6Dfh8RHzWdov3pELL-pQ4_azt5dNmg7C6eIjXWR7mXo6_dM88Dlgvn3ngggLDsG93Tyg4pBCwSrg Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:08:53.992248 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0b789cb75bc24a898888246a7745537e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0b789cb75bc24a898888246a7745537e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0b789cb75bc24a898888246a7745537e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 0b789cb75bc24a898888246a7745537e Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1242041463 Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: 27653498cd0a4e089f1cbc43470182ee Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-AttachVolumeNegativeTest-1242041463-project Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:08:53.993957 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': '550286be-d749-4dff-9def-2d2a3bb0a283'} Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:08:53.994999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. Sep 01 15:08:53.996549 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:08:53.998726 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] Returning 404 to user: Instance 550286be-d749-4dff-9def-2d2a3bb0a283 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:08:53.998726 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-12350600-fd69-444c-ab33-fbd1bbd5c063 tempest-AttachVolumeNegativeTest-1242041463 tempest-AttachVolumeNegativeTest-1242041463-project] 10.222.0.33 "GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283" status: 404 len: 111 microversion: 2.1 time: 0.030267 Sep 01 15:08:53.998726 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 516/1030] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:08:53 2022] GET /compute/v2.1/servers/550286be-d749-4dff-9def-2d2a3bb0a283 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:09:48.436594 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-1c0f03ac-008d-4cea-89cc-e50fe6a84336 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:48.437730 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1c0f03ac-008d-4cea-89cc-e50fe6a84336 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:48.439772 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:09:48.441146 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_api:SELECT=34 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:09:48.441357 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:09:48.442863 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:09:48.447759 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c0f03ac-008d-4cea-89cc-e50fe6a84336 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:48.448569 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c0f03ac-008d-4cea-89cc-e50fe6a84336 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:48.449165 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c0f03ac-008d-4cea-89cc-e50fe6a84336 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:48.450231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c0f03ac-008d-4cea-89cc-e50fe6a84336 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:48.450916 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c0f03ac-008d-4cea-89cc-e50fe6a84336 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:48.451441 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-1c0f03ac-008d-4cea-89cc-e50fe6a84336 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:48.482386 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-1c0f03ac-008d-4cea-89cc-e50fe6a84336 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Going to try to terminate instance {{(pid=120553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:09:48.569554 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-1c0f03ac-008d-4cea-89cc-e50fe6a84336 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "DELETE /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 204 len: 0 microversion: 2.1 time: 0.136857 Sep 01 15:09:48.574988 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 515/1031] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:09:48 2022] DELETE /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:09:48.584717 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-b7e49a5f-1986-4c18-8418-156d85964587 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:48.585516 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-b7e49a5f-1986-4c18-8418-156d85964587 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:48.592209 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b7e49a5f-1986-4c18-8418-156d85964587 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:48.592751 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b7e49a5f-1986-4c18-8418-156d85964587 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:48.593195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b7e49a5f-1986-4c18-8418-156d85964587 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:48.593960 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b7e49a5f-1986-4c18-8418-156d85964587 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:48.595158 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b7e49a5f-1986-4c18-8418-156d85964587 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:48.595592 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-b7e49a5f-1986-4c18-8418-156d85964587 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:48.597315 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-3c6de8f7-7147-44ad-905d-bef1f21ec3cb req-0c555a4b-99b8-4509-a870-ca1e7c10a3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be64d588-2a22-4c84-b763-dbd89e476a69", "tag": "4ae7b8f7-3330-4928-b35e-6143ba6cd144"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:09:48.607833 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3c6de8f7-7147-44ad-905d-bef1f21ec3cb req-0c555a4b-99b8-4509-a870-ca1e7c10a3d8 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:48.608570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3c6de8f7-7147-44ad-905d-bef1f21ec3cb req-0c555a4b-99b8-4509-a870-ca1e7c10a3d8 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:48.609024 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-3c6de8f7-7147-44ad-905d-bef1f21ec3cb req-0c555a4b-99b8-4509-a870-ca1e7c10a3d8 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:48.621349 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-3c6de8f7-7147-44ad-905d-bef1f21ec3cb req-0c555a4b-99b8-4509-a870-ca1e7c10a3d8 service nova] Creating event network-changed:4ae7b8f7-3330-4928-b35e-6143ba6cd144 for instance be64d588-2a22-4c84-b763-dbd89e476a69 on hv-cinder-85505 Sep 01 15:09:48.626750 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-3c6de8f7-7147-44ad-905d-bef1f21ec3cb req-0c555a4b-99b8-4509-a870-ca1e7c10a3d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192029 Sep 01 15:09:48.630299 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 517/1032] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:09:48.747356 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-b7e49a5f-1986-4c18-8418-156d85964587 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:48.755505 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-b7e49a5f-1986-4c18-8418-156d85964587 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1576 microversion: 2.1 time: 0.179758 Sep 01 15:09:48.756066 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 516/1033] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:48 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:49.120704 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1839742504", "imageRef": "c350b0ef-0518-415c-91ad-96b154d7562d", "flavorRef": "452"}} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:09:49.171568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.network.neutron [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] validate_networks() for None {{(pid=120554) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 15:09:49.454650 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Flavor limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 15:09:49.455237 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Image limits 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 15:09:49.455528 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Flavor pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 15:09:49.455937 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Image pref 0:0:0 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 15:09:49.456348 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.virt.hardware [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 15:09:49.466105 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:49.466625 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:49.467069 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:49.467830 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:49.468289 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:49.468718 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:49.485822 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Getting quotas for project d429d17d00c24f22b74b56446fcaf35a. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 15:09:49.489754 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.quota [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Getting quotas for user 2c138f1d6eb441228a9770f1c8c36778 and project d429d17d00c24f22b74b56446fcaf35a. Resources: {'ram', 'instances', 'cores'} {{(pid=120554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 15:09:49.502209 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Going to run 1 instances... {{(pid=120554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 15:09:49.504756 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c350b0ef-0518-415c-91ad-96b154d7562d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 15:09:49.551765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-133b9ed9-9f12-449e-90ef-f4d9f09c294a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.435273 Sep 01 15:09:49.552401 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 518/1034] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 1 15:09:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 15:09:49.563707 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-d0bac99e-cf21-4a2f-8374-03125cd54cd0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:49.564322 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-d0bac99e-cf21-4a2f-8374-03125cd54cd0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:49.618656 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-d0bac99e-cf21-4a2f-8374-03125cd54cd0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:49.626859 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-d0bac99e-cf21-4a2f-8374-03125cd54cd0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1215 microversion: 2.1 time: 0.067006 Sep 01 15:09:49.627534 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 517/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:49 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:49.777768 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-2e4a6c57-ac1a-40e5-9ca9-115e6b03394b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:49.778686 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-2e4a6c57-ac1a-40e5-9ca9-115e6b03394b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:49.785074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2e4a6c57-ac1a-40e5-9ca9-115e6b03394b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:49.785558 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2e4a6c57-ac1a-40e5-9ca9-115e6b03394b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:49.785993 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2e4a6c57-ac1a-40e5-9ca9-115e6b03394b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:49.786719 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2e4a6c57-ac1a-40e5-9ca9-115e6b03394b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:49.787171 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2e4a6c57-ac1a-40e5-9ca9-115e6b03394b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:49.787593 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-2e4a6c57-ac1a-40e5-9ca9-115e6b03394b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:49.930348 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-2e4a6c57-ac1a-40e5-9ca9-115e6b03394b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:49.939410 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-2e4a6c57-ac1a-40e5-9ca9-115e6b03394b tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1576 microversion: 2.1 time: 0.166579 Sep 01 15:09:49.939984 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 519/1036] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:49 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 15:09:50.646616 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-11a356e0-24f8-4ac2-b485-072540557b17 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:50.647236 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-11a356e0-24f8-4ac2-b485-072540557b17 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:50.654508 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11a356e0-24f8-4ac2-b485-072540557b17 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:50.655006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11a356e0-24f8-4ac2-b485-072540557b17 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:50.655449 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11a356e0-24f8-4ac2-b485-072540557b17 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:50.656150 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11a356e0-24f8-4ac2-b485-072540557b17 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:50.656611 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11a356e0-24f8-4ac2-b485-072540557b17 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:50.657044 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-11a356e0-24f8-4ac2-b485-072540557b17 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:50.721720 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-11a356e0-24f8-4ac2-b485-072540557b17 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:50.729293 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-11a356e0-24f8-4ac2-b485-072540557b17 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1219 microversion: 2.1 time: 0.086502 Sep 01 15:09:50.729849 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 518/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:50 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:50.960999 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-856071b8-1009-4342-83d8-33ef967d34c1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:50.961554 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-856071b8-1009-4342-83d8-33ef967d34c1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:50.968751 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-856071b8-1009-4342-83d8-33ef967d34c1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:50.969239 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-856071b8-1009-4342-83d8-33ef967d34c1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:50.969681 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-856071b8-1009-4342-83d8-33ef967d34c1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:50.970411 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-856071b8-1009-4342-83d8-33ef967d34c1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:50.970872 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-856071b8-1009-4342-83d8-33ef967d34c1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:50.971305 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-856071b8-1009-4342-83d8-33ef967d34c1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:51.103399 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-856071b8-1009-4342-83d8-33ef967d34c1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:51.111100 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-856071b8-1009-4342-83d8-33ef967d34c1 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1576 microversion: 2.1 time: 0.154055 Sep 01 15:09:51.111656 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 520/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:50 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:51.750655 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-4e801c35-a44d-4cef-89d0-c4c8f36c5654 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:51.751273 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-4e801c35-a44d-4cef-89d0-c4c8f36c5654 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:51.757603 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4e801c35-a44d-4cef-89d0-c4c8f36c5654 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:51.758091 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4e801c35-a44d-4cef-89d0-c4c8f36c5654 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:51.758565 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4e801c35-a44d-4cef-89d0-c4c8f36c5654 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:51.759255 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4e801c35-a44d-4cef-89d0-c4c8f36c5654 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:51.759716 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4e801c35-a44d-4cef-89d0-c4c8f36c5654 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:51.760142 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-4e801c35-a44d-4cef-89d0-c4c8f36c5654 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:51.824365 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-4e801c35-a44d-4cef-89d0-c4c8f36c5654 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:51.831987 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-4e801c35-a44d-4cef-89d0-c4c8f36c5654 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1219 microversion: 2.1 time: 0.085237 Sep 01 15:09:51.832545 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 519/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:51 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:52.131951 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-11b4f02f-59bc-4692-93f8-44244f9de117 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:52.132569 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-11b4f02f-59bc-4692-93f8-44244f9de117 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:52.139590 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-11b4f02f-59bc-4692-93f8-44244f9de117 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:52.140072 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-11b4f02f-59bc-4692-93f8-44244f9de117 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:52.140510 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-11b4f02f-59bc-4692-93f8-44244f9de117 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:52.141195 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-11b4f02f-59bc-4692-93f8-44244f9de117 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:52.141649 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-11b4f02f-59bc-4692-93f8-44244f9de117 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:52.142074 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-11b4f02f-59bc-4692-93f8-44244f9de117 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:52.277178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-11b4f02f-59bc-4692-93f8-44244f9de117 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:52.285254 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-11b4f02f-59bc-4692-93f8-44244f9de117 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1576 microversion: 2.1 time: 0.157210 Sep 01 15:09:52.298717 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 521/1040] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:52 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:52.320492 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-7f259878-642a-4cad-a9da-fc1917fadb42 req-6a0ec7e8-0c70-44bf-8aa8-1a64793a89e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be64d588-2a22-4c84-b763-dbd89e476a69", "name": "network-vif-unplugged", "status": "completed", "tag": "4ae7b8f7-3330-4928-b35e-6143ba6cd144"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:09:52.333415 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-7f259878-642a-4cad-a9da-fc1917fadb42 req-6a0ec7e8-0c70-44bf-8aa8-1a64793a89e1 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:52.333897 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-7f259878-642a-4cad-a9da-fc1917fadb42 req-6a0ec7e8-0c70-44bf-8aa8-1a64793a89e1 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:52.334353 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-7f259878-642a-4cad-a9da-fc1917fadb42 req-6a0ec7e8-0c70-44bf-8aa8-1a64793a89e1 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:52.344951 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-7f259878-642a-4cad-a9da-fc1917fadb42 req-6a0ec7e8-0c70-44bf-8aa8-1a64793a89e1 service nova] Creating event network-vif-unplugged:4ae7b8f7-3330-4928-b35e-6143ba6cd144 for instance be64d588-2a22-4c84-b763-dbd89e476a69 on hv-cinder-85505 Sep 01 15:09:52.349760 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-7f259878-642a-4cad-a9da-fc1917fadb42 req-6a0ec7e8-0c70-44bf-8aa8-1a64793a89e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095591 Sep 01 15:09:52.350346 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 520/1041] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 15:09:52.852758 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7d7fc817-f0ae-4b5d-bcd5-ab9257274ba0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:52.854065 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7d7fc817-f0ae-4b5d-bcd5-ab9257274ba0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:52.860091 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d7fc817-f0ae-4b5d-bcd5-ab9257274ba0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:52.860570 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d7fc817-f0ae-4b5d-bcd5-ab9257274ba0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:52.861002 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d7fc817-f0ae-4b5d-bcd5-ab9257274ba0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:52.861681 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d7fc817-f0ae-4b5d-bcd5-ab9257274ba0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:52.862136 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d7fc817-f0ae-4b5d-bcd5-ab9257274ba0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:52.862586 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7d7fc817-f0ae-4b5d-bcd5-ab9257274ba0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:52.922852 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-7d7fc817-f0ae-4b5d-bcd5-ab9257274ba0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:52.930406 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7d7fc817-f0ae-4b5d-bcd5-ab9257274ba0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1219 microversion: 2.1 time: 0.081486 Sep 01 15:09:52.930969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 522/1042] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:52 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:53.307355 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-e0a72736-1b35-4b0f-80d5-6dd701245ebb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:53.307960 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-e0a72736-1b35-4b0f-80d5-6dd701245ebb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:53.314090 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0a72736-1b35-4b0f-80d5-6dd701245ebb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:53.314612 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0a72736-1b35-4b0f-80d5-6dd701245ebb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:53.315052 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0a72736-1b35-4b0f-80d5-6dd701245ebb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:53.315745 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0a72736-1b35-4b0f-80d5-6dd701245ebb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:53.316209 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0a72736-1b35-4b0f-80d5-6dd701245ebb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:53.316639 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-e0a72736-1b35-4b0f-80d5-6dd701245ebb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:53.444059 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-e0a72736-1b35-4b0f-80d5-6dd701245ebb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:53.452205 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-e0a72736-1b35-4b0f-80d5-6dd701245ebb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1576 microversion: 2.1 time: 0.149667 Sep 01 15:09:53.452756 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 521/1043] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:53 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:53.951700 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ef12a831-82b1-4ca7-a731-60dbe7491219 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:53.952359 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ef12a831-82b1-4ca7-a731-60dbe7491219 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:53.958619 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef12a831-82b1-4ca7-a731-60dbe7491219 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:53.959101 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef12a831-82b1-4ca7-a731-60dbe7491219 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:53.959536 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef12a831-82b1-4ca7-a731-60dbe7491219 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:53.960217 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef12a831-82b1-4ca7-a731-60dbe7491219 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:53.960672 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef12a831-82b1-4ca7-a731-60dbe7491219 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:53.961093 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ef12a831-82b1-4ca7-a731-60dbe7491219 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:54.020949 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ef12a831-82b1-4ca7-a731-60dbe7491219 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:54.029223 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ef12a831-82b1-4ca7-a731-60dbe7491219 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1219 microversion: 2.1 time: 0.081466 Sep 01 15:09:54.029772 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 523/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:53 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:54.473479 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-57f026e5-b87b-44c6-ab88-f3d5b3d24ade tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:54.474134 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-57f026e5-b87b-44c6-ab88-f3d5b3d24ade tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:54.481153 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57f026e5-b87b-44c6-ab88-f3d5b3d24ade tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:54.481642 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57f026e5-b87b-44c6-ab88-f3d5b3d24ade tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:54.482085 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57f026e5-b87b-44c6-ab88-f3d5b3d24ade tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:54.482806 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57f026e5-b87b-44c6-ab88-f3d5b3d24ade tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:54.483269 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57f026e5-b87b-44c6-ab88-f3d5b3d24ade tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:54.483698 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-57f026e5-b87b-44c6-ab88-f3d5b3d24ade tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:54.623084 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-57f026e5-b87b-44c6-ab88-f3d5b3d24ade tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:54.631017 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-57f026e5-b87b-44c6-ab88-f3d5b3d24ade tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1576 microversion: 2.1 time: 0.161422 Sep 01 15:09:54.631570 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 522/1045] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:54 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:55.049976 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-f87d6932-e3bb-4204-9580-8ffdc601d2ca tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:55.050636 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-f87d6932-e3bb-4204-9580-8ffdc601d2ca tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:55.057459 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f87d6932-e3bb-4204-9580-8ffdc601d2ca tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:55.057940 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f87d6932-e3bb-4204-9580-8ffdc601d2ca tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:55.058503 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f87d6932-e3bb-4204-9580-8ffdc601d2ca tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:55.059188 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f87d6932-e3bb-4204-9580-8ffdc601d2ca tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:55.059644 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f87d6932-e3bb-4204-9580-8ffdc601d2ca tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:55.060064 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-f87d6932-e3bb-4204-9580-8ffdc601d2ca tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:55.122334 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-f87d6932-e3bb-4204-9580-8ffdc601d2ca tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:55.132438 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-f87d6932-e3bb-4204-9580-8ffdc601d2ca tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1219 microversion: 2.1 time: 0.086112 Sep 01 15:09:55.143382 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 524/1046] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:55 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:55.652586 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a3fb771d-5a75-4d66-8ebd-791113737528 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:55.653323 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a3fb771d-5a75-4d66-8ebd-791113737528 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:55.665258 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a3fb771d-5a75-4d66-8ebd-791113737528 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:55.667026 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a3fb771d-5a75-4d66-8ebd-791113737528 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:55.667026 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a3fb771d-5a75-4d66-8ebd-791113737528 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:55.667759 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a3fb771d-5a75-4d66-8ebd-791113737528 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:55.668216 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a3fb771d-5a75-4d66-8ebd-791113737528 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:55.668767 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a3fb771d-5a75-4d66-8ebd-791113737528 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:55.772231 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a3fb771d-5a75-4d66-8ebd-791113737528 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:55.781216 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a3fb771d-5a75-4d66-8ebd-791113737528 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 200 len: 1509 microversion: 2.1 time: 0.132729 Sep 01 15:09:55.782280 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 523/1047] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:55 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 1509 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:55.925814 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-e63d02a4-4788-420b-ac30-59ea1f48b9c3 req-afae13f0-bf93-4791-87f2-e2440c3a7299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be64d588-2a22-4c84-b763-dbd89e476a69", "name": "network-vif-deleted", "tag": "4ae7b8f7-3330-4928-b35e-6143ba6cd144"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:09:55.939620 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-e63d02a4-4788-420b-ac30-59ea1f48b9c3 req-afae13f0-bf93-4791-87f2-e2440c3a7299 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:55.940334 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-e63d02a4-4788-420b-ac30-59ea1f48b9c3 req-afae13f0-bf93-4791-87f2-e2440c3a7299 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:55.940965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-e63d02a4-4788-420b-ac30-59ea1f48b9c3 req-afae13f0-bf93-4791-87f2-e2440c3a7299 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:55.953542 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-e63d02a4-4788-420b-ac30-59ea1f48b9c3 req-afae13f0-bf93-4791-87f2-e2440c3a7299 service nova] Creating event network-vif-deleted:4ae7b8f7-3330-4928-b35e-6143ba6cd144 for instance be64d588-2a22-4c84-b763-dbd89e476a69 on hv-cinder-85505 Sep 01 15:09:55.958701 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-e63d02a4-4788-420b-ac30-59ea1f48b9c3 req-afae13f0-bf93-4791-87f2-e2440c3a7299 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097677 Sep 01 15:09:55.959292 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 525/1048] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:09:56.156039 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-45f72736-03e1-4d28-a2a2-a692d8720608 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:56.156259 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-45f72736-03e1-4d28-a2a2-a692d8720608 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:56.166750 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45f72736-03e1-4d28-a2a2-a692d8720608 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:56.167476 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45f72736-03e1-4d28-a2a2-a692d8720608 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:56.167829 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45f72736-03e1-4d28-a2a2-a692d8720608 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:56.168722 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45f72736-03e1-4d28-a2a2-a692d8720608 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:56.169193 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45f72736-03e1-4d28-a2a2-a692d8720608 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:56.169739 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-45f72736-03e1-4d28-a2a2-a692d8720608 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:56.260806 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-45f72736-03e1-4d28-a2a2-a692d8720608 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:56.269290 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-45f72736-03e1-4d28-a2a2-a692d8720608 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1273 microversion: 2.1 time: 0.117335 Sep 01 15:09:56.269873 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 524/1049] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:56 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:56.806582 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:56.807938 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: be64d588-2a22-4c84-b763-dbd89e476a69] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:56.814416 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:56.815129 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:56.815753 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:56.816465 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:56.816936 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:56.817367 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:56.833441 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] HTTP exception thrown: Instance be64d588-2a22-4c84-b763-dbd89e476a69 could not be found. Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Request method failure captured: Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 HTTP/1.1 Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMmM5arFh5_6MDEdv1X28eUF86VGRpd75Ifpn2OamslpHrHxi4vmRcBA83KmQJ7E-QGnspEfEbyeVLHxAlC8q-L77SYqkB3G56JV2eZ3N59_uzufLmUFVkXlzTomnnxFjNxKu5PM6ILUDztvIp7aT18FhA2APucWwZKSOocq3Q78lWw Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 3e49151735934f21a2ea909842e36a05 Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:09:56.835380 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3e49151735934f21a2ea909842e36a05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e49151735934f21a2ea909842e36a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3e49151735934f21a2ea909842e36a05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e49151735934f21a2ea909842e36a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 3e49151735934f21a2ea909842e36a05 Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-TestVolumeBootPattern-1713390008-project Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: afa6212f31034e27a8d32f114937190e Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-TestVolumeBootPattern-1713390008-project Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance be64d588-2a22-4c84-b763-dbd89e476a69 could not be found. Sep 01 15:09:56.837009 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': 'be64d588-2a22-4c84-b763-dbd89e476a69'} Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be64d588-2a22-4c84-b763-dbd89e476a69 could not be found. Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:09:56.838160 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be64d588-2a22-4c84-b763-dbd89e476a69 could not be found. Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be64d588-2a22-4c84-b763-dbd89e476a69 could not be found. Sep 01 15:09:56.839606 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:09:56.841790 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Returning 404 to user: Instance be64d588-2a22-4c84-b763-dbd89e476a69 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:09:56.841790 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-99e23337-5ccf-4446-8d88-eda5a551f77f tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69" status: 404 len: 111 microversion: 2.1 time: 0.035625 Sep 01 15:09:56.841790 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 526/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:56 2022] GET /compute/v2.1/servers/be64d588-2a22-4c84-b763-dbd89e476a69 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:09:57.292730 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-be6df338-934a-422f-a398-8b4290306ef0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:57.293381 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-be6df338-934a-422f-a398-8b4290306ef0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:57.299763 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-be6df338-934a-422f-a398-8b4290306ef0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:57.300247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-be6df338-934a-422f-a398-8b4290306ef0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:57.300687 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-be6df338-934a-422f-a398-8b4290306ef0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:57.301379 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-be6df338-934a-422f-a398-8b4290306ef0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:57.301841 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-be6df338-934a-422f-a398-8b4290306ef0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:57.302287 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-be6df338-934a-422f-a398-8b4290306ef0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:57.539170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-be6df338-934a-422f-a398-8b4290306ef0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:57.548112 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-be6df338-934a-422f-a398-8b4290306ef0 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1315 microversion: 2.1 time: 0.259921 Sep 01 15:09:57.548726 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 525/1051] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:57 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:57.978556 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-49bb5f35-a8e1-4f1c-b858-2bc1be15b1c2 req-6a19988a-6b71-4d9e-96de-b11beb9ce617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fa012c-6d65-486c-90be-e3431f3175a4", "tag": "f8757685-ed8b-409e-bb11-1918e6318e29"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:09:57.988730 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-49bb5f35-a8e1-4f1c-b858-2bc1be15b1c2 req-6a19988a-6b71-4d9e-96de-b11beb9ce617 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:57.990033 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-49bb5f35-a8e1-4f1c-b858-2bc1be15b1c2 req-6a19988a-6b71-4d9e-96de-b11beb9ce617 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:57.990033 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-49bb5f35-a8e1-4f1c-b858-2bc1be15b1c2 req-6a19988a-6b71-4d9e-96de-b11beb9ce617 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:58.005285 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-49bb5f35-a8e1-4f1c-b858-2bc1be15b1c2 req-6a19988a-6b71-4d9e-96de-b11beb9ce617 service nova] Creating event network-changed:f8757685-ed8b-409e-bb11-1918e6318e29 for instance 19fa012c-6d65-486c-90be-e3431f3175a4 on hv-cinder-85505 Sep 01 15:09:58.010952 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-49bb5f35-a8e1-4f1c-b858-2bc1be15b1c2 req-6a19988a-6b71-4d9e-96de-b11beb9ce617 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035915 Sep 01 15:09:58.011953 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 527/1052] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:09:58.568957 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-0daef6b0-6c19-4953-a4bd-d78190053812 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:58.569557 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-0daef6b0-6c19-4953-a4bd-d78190053812 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:58.576066 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0daef6b0-6c19-4953-a4bd-d78190053812 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:58.576547 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0daef6b0-6c19-4953-a4bd-d78190053812 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:58.576982 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0daef6b0-6c19-4953-a4bd-d78190053812 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:58.577667 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0daef6b0-6c19-4953-a4bd-d78190053812 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:58.578124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0daef6b0-6c19-4953-a4bd-d78190053812 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:58.578583 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-0daef6b0-6c19-4953-a4bd-d78190053812 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:58.711281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-0daef6b0-6c19-4953-a4bd-d78190053812 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:58.719447 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-0daef6b0-6c19-4953-a4bd-d78190053812 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1315 microversion: 2.1 time: 0.154411 Sep 01 15:09:58.720006 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 526/1053] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:58 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:59.740845 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=2 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:09:59.742925 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell0:SELECT=6 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:09:59.748516 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-440f6dd1-28f2-47ff-a318-9aeb1b055c4a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:59.749615 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-440f6dd1-28f2-47ff-a318-9aeb1b055c4a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:59.757313 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-440f6dd1-28f2-47ff-a318-9aeb1b055c4a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:59.757804 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-440f6dd1-28f2-47ff-a318-9aeb1b055c4a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:59.758262 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-440f6dd1-28f2-47ff-a318-9aeb1b055c4a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:59.758965 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-440f6dd1-28f2-47ff-a318-9aeb1b055c4a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:09:59.759992 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-440f6dd1-28f2-47ff-a318-9aeb1b055c4a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:09:59.760419 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-440f6dd1-28f2-47ff-a318-9aeb1b055c4a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:09:59.976275 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-440f6dd1-28f2-47ff-a318-9aeb1b055c4a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:09:59.984747 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-f506426f-643e-4e20-b687-46416562c320 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:09:59.985292 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-440f6dd1-28f2-47ff-a318-9aeb1b055c4a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1315 microversion: 2.1 time: 0.246684 Sep 01 15:09:59.985444 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f506426f-643e-4e20-b687-46416562c320 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:09:59.998708 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 528/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:09:59 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:09:59.998708 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-ac0619e5-4707-43fd-bb2d-b3ee4e1e9277 req-54b913ef-eb87-451d-b313-9649faac9fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f93b75-c5e6-4033-b466-76f23c7dc24a", "tag": "93b9430d-fd86-4cba-94ec-29862feb744c"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:09:59.999969 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-ac0619e5-4707-43fd-bb2d-b3ee4e1e9277 req-54b913ef-eb87-451d-b313-9649faac9fd2 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:00.000540 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-ac0619e5-4707-43fd-bb2d-b3ee4e1e9277 req-54b913ef-eb87-451d-b313-9649faac9fd2 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:00.001033 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-ac0619e5-4707-43fd-bb2d-b3ee4e1e9277 req-54b913ef-eb87-451d-b313-9649faac9fd2 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:00.003458 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell0:SELECT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:10:00.011960 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f506426f-643e-4e20-b687-46416562c320 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:00.013080 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-ac0619e5-4707-43fd-bb2d-b3ee4e1e9277 req-54b913ef-eb87-451d-b313-9649faac9fd2 service nova] Creating event network-changed:93b9430d-fd86-4cba-94ec-29862feb744c for instance e3f93b75-c5e6-4033-b466-76f23c7dc24a on hv-cinder-85505 Sep 01 15:10:00.013424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f506426f-643e-4e20-b687-46416562c320 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:00.014105 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f506426f-643e-4e20-b687-46416562c320 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:00.015043 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f506426f-643e-4e20-b687-46416562c320 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:00.015901 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f506426f-643e-4e20-b687-46416562c320 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:00.017746 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-f506426f-643e-4e20-b687-46416562c320 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:00.018596 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-ac0619e5-4707-43fd-bb2d-b3ee4e1e9277 req-54b913ef-eb87-451d-b313-9649faac9fd2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031753 Sep 01 15:10:00.019192 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 529/1055] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:10:00.047753 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-f506426f-643e-4e20-b687-46416562c320 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Going to try to terminate instance {{(pid=120553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:10:00.139414 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-f506426f-643e-4e20-b687-46416562c320 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 204 len: 0 microversion: 2.1 time: 0.158475 Sep 01 15:10:00.141204 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 527/1056] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:09:59 2022] DELETE /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:10:00.151008 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-ecfb329b-fe73-4fbc-8335-c5632102d043 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:00.152101 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-ecfb329b-fe73-4fbc-8335-c5632102d043 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:00.158514 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfb329b-fe73-4fbc-8335-c5632102d043 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:00.159357 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfb329b-fe73-4fbc-8335-c5632102d043 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:00.160026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfb329b-fe73-4fbc-8335-c5632102d043 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:00.160948 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfb329b-fe73-4fbc-8335-c5632102d043 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:00.161642 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfb329b-fe73-4fbc-8335-c5632102d043 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:00.162159 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-ecfb329b-fe73-4fbc-8335-c5632102d043 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:00.315471 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-ecfb329b-fe73-4fbc-8335-c5632102d043 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:10:00.323749 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-ecfb329b-fe73-4fbc-8335-c5632102d043 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1576 microversion: 2.1 time: 0.176951 Sep 01 15:10:00.324405 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 530/1057] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:00 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:10:01.013409 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-a99492b1-c280-45c9-9ea8-1c4d7ae31c5a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:01.014113 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-a99492b1-c280-45c9-9ea8-1c4d7ae31c5a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:01.020565 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a99492b1-c280-45c9-9ea8-1c4d7ae31c5a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:01.021046 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a99492b1-c280-45c9-9ea8-1c4d7ae31c5a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:01.021484 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a99492b1-c280-45c9-9ea8-1c4d7ae31c5a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:01.022169 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a99492b1-c280-45c9-9ea8-1c4d7ae31c5a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:01.022654 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a99492b1-c280-45c9-9ea8-1c4d7ae31c5a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:01.023077 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-a99492b1-c280-45c9-9ea8-1c4d7ae31c5a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:01.150336 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-a99492b1-c280-45c9-9ea8-1c4d7ae31c5a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:10:01.157816 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-a99492b1-c280-45c9-9ea8-1c4d7ae31c5a tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1315 microversion: 2.1 time: 0.149356 Sep 01 15:10:01.158394 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 528/1058] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:01 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:10:01.345255 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-745e6885-3358-46ed-873b-70e7269b66c9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:01.345856 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-745e6885-3358-46ed-873b-70e7269b66c9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:01.352353 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-745e6885-3358-46ed-873b-70e7269b66c9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:01.353422 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-745e6885-3358-46ed-873b-70e7269b66c9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:01.353862 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-745e6885-3358-46ed-873b-70e7269b66c9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:01.354587 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-745e6885-3358-46ed-873b-70e7269b66c9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:01.355041 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-745e6885-3358-46ed-873b-70e7269b66c9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:01.355467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-745e6885-3358-46ed-873b-70e7269b66c9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:01.484179 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-745e6885-3358-46ed-873b-70e7269b66c9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:10:01.491847 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-745e6885-3358-46ed-873b-70e7269b66c9 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1576 microversion: 2.1 time: 0.150414 Sep 01 15:10:01.492433 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 531/1059] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:01 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:10:02.081761 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-049cffee-33fa-4dbe-bc21-9b795b4edf83 req-4d121a42-e30f-45a0-82e0-e706e792d0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f93b75-c5e6-4033-b466-76f23c7dc24a", "name": "network-vif-deleted", "tag": "93b9430d-fd86-4cba-94ec-29862feb744c"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:10:02.092001 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-049cffee-33fa-4dbe-bc21-9b795b4edf83 req-4d121a42-e30f-45a0-82e0-e706e792d0f0 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:02.092485 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-049cffee-33fa-4dbe-bc21-9b795b4edf83 req-4d121a42-e30f-45a0-82e0-e706e792d0f0 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:02.093136 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-049cffee-33fa-4dbe-bc21-9b795b4edf83 req-4d121a42-e30f-45a0-82e0-e706e792d0f0 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:02.104727 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-049cffee-33fa-4dbe-bc21-9b795b4edf83 req-4d121a42-e30f-45a0-82e0-e706e792d0f0 service nova] Creating event network-vif-deleted:93b9430d-fd86-4cba-94ec-29862feb744c for instance e3f93b75-c5e6-4033-b466-76f23c7dc24a on hv-cinder-85505 Sep 01 15:10:02.109442 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-049cffee-33fa-4dbe-bc21-9b795b4edf83 req-4d121a42-e30f-45a0-82e0-e706e792d0f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031380 Sep 01 15:10:02.110042 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 529/1060] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:10:02.178015 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-d9235741-f65e-4d01-bd86-b317daa55440 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:02.178667 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-d9235741-f65e-4d01-bd86-b317daa55440 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:02.185589 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d9235741-f65e-4d01-bd86-b317daa55440 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:02.186178 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d9235741-f65e-4d01-bd86-b317daa55440 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:02.186716 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d9235741-f65e-4d01-bd86-b317daa55440 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:02.187496 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d9235741-f65e-4d01-bd86-b317daa55440 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:02.187971 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d9235741-f65e-4d01-bd86-b317daa55440 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:02.188408 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-d9235741-f65e-4d01-bd86-b317daa55440 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:02.322892 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-d9235741-f65e-4d01-bd86-b317daa55440 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:10:02.332595 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-d9235741-f65e-4d01-bd86-b317daa55440 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1315 microversion: 2.1 time: 0.158227 Sep 01 15:10:02.333214 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 532/1061] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:02 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:10:02.435854 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [req-39da5e48-dd8a-4bde-b057-be1d9259dd28 req-201cb9be-9536-42cd-b2e2-a702cd81bb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fa012c-6d65-486c-90be-e3431f3175a4", "name": "network-vif-plugged", "status": "completed", "tag": "f8757685-ed8b-409e-bb11-1918e6318e29"}]} {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:10:02.447727 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-39da5e48-dd8a-4bde-b057-be1d9259dd28 req-201cb9be-9536-42cd-b2e2-a702cd81bb10 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:02.448786 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-39da5e48-dd8a-4bde-b057-be1d9259dd28 req-201cb9be-9536-42cd-b2e2-a702cd81bb10 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:02.449602 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [req-39da5e48-dd8a-4bde-b057-be1d9259dd28 req-201cb9be-9536-42cd-b2e2-a702cd81bb10 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:02.466631 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.compute.server_external_events [req-39da5e48-dd8a-4bde-b057-be1d9259dd28 req-201cb9be-9536-42cd-b2e2-a702cd81bb10 service nova] Creating event network-vif-plugged:f8757685-ed8b-409e-bb11-1918e6318e29 for instance 19fa012c-6d65-486c-90be-e3431f3175a4 on hv-cinder-85505 Sep 01 15:10:02.471799 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [req-39da5e48-dd8a-4bde-b057-be1d9259dd28 req-201cb9be-9536-42cd-b2e2-a702cd81bb10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040226 Sep 01 15:10:02.472418 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 530/1062] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:10:02.513481 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:02.514098 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:02.520623 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:02.521112 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:02.521871 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:02.522781 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:02.523423 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:02.524026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:02.555600 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:02.556534 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:02.556976 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:02.557421 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.objects.instance [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lazy-loading 'fault' on Instance uuid e3f93b75-c5e6-4033-b466-76f23c7dc24a {{(pid=120554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 15:10:02.597728 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.policy [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afa6212f31034e27a8d32f114937190e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e49151735934f21a2ea909842e36a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120554) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:10:02.605736 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-5d1eb4e6-d66a-402c-ad2c-d36ae6195fdb tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 200 len: 1229 microversion: 2.1 time: 0.096677 Sep 01 15:10:02.606269 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 533/1063] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:02 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:10:03.354255 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-ecf8ead9-41d6-4350-b7b9-0207368f1758 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:03.354961 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-ecf8ead9-41d6-4350-b7b9-0207368f1758 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:03.361076 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ecf8ead9-41d6-4350-b7b9-0207368f1758 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:03.361559 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ecf8ead9-41d6-4350-b7b9-0207368f1758 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:03.362002 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ecf8ead9-41d6-4350-b7b9-0207368f1758 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:03.362724 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ecf8ead9-41d6-4350-b7b9-0207368f1758 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:03.363184 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ecf8ead9-41d6-4350-b7b9-0207368f1758 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:03.363614 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-ecf8ead9-41d6-4350-b7b9-0207368f1758 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:03.367684 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG dbcounter [-] [120553] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:10:03.491827 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-ecf8ead9-41d6-4350-b7b9-0207368f1758 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:10:03.499989 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-ecf8ead9-41d6-4350-b7b9-0207368f1758 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1315 microversion: 2.1 time: 0.149957 Sep 01 15:10:03.500552 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 531/1064] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:03 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:10:03.627203 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:03.627765 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e3f93b75-c5e6-4033-b466-76f23c7dc24a] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:03.634637 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:03.635115 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:03.635548 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:03.636228 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:03.636680 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:03.637097 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:03.650820 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] HTTP exception thrown: Instance e3f93b75-c5e6-4033-b466-76f23c7dc24a could not be found. Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Request method failure captured: Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a HTTP/1.1 Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMmM5arFh5_6MDEdv1X28eUF86VGRpd75Ifpn2OamslpHrHxi4vmRcBA83KmQJ7E-QGnspEfEbyeVLHxAlC8q-L77SYqkB3G56JV2eZ3N59_uzufLmUFVkXlzTomnnxFjNxKu5PM6ILUDztvIp7aT18FhA2APucWwZKSOocq3Q78lWw Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 3e49151735934f21a2ea909842e36a05 Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:10:03.652475 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3e49151735934f21a2ea909842e36a05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e49151735934f21a2ea909842e36a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3e49151735934f21a2ea909842e36a05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e49151735934f21a2ea909842e36a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 3e49151735934f21a2ea909842e36a05 Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-TestVolumeBootPattern-1713390008-project Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: afa6212f31034e27a8d32f114937190e Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-TestVolumeBootPattern-1713390008-project Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance e3f93b75-c5e6-4033-b466-76f23c7dc24a could not be found. Sep 01 15:10:03.654031 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': 'e3f93b75-c5e6-4033-b466-76f23c7dc24a'} Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f93b75-c5e6-4033-b466-76f23c7dc24a could not be found. Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:10:03.654919 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f93b75-c5e6-4033-b466-76f23c7dc24a could not be found. Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f93b75-c5e6-4033-b466-76f23c7dc24a could not be found. Sep 01 15:10:03.656511 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:10:03.657951 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Returning 404 to user: Instance e3f93b75-c5e6-4033-b466-76f23c7dc24a could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:10:03.657951 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-7ec70775-25c5-416a-bb31-ed9f9e6c775a tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a" status: 404 len: 111 microversion: 2.1 time: 0.030668 Sep 01 15:10:03.657951 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 534/1065] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:03 2022] GET /compute/v2.1/servers/e3f93b75-c5e6-4033-b466-76f23c7dc24a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:10:04.095788 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:04.096306 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:04.102201 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:04.102756 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:04.103195 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:04.103880 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:04.104336 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:04.104758 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:04.117813 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] HTTP exception thrown: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Request method failure captured: Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: DELETE /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 HTTP/1.1 Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMmM5arFh5_6MDEdv1X28eUF86VGRpd75Ifpn2OamslpHrHxi4vmRcBA83KmQJ7E-QGnspEfEbyeVLHxAlC8q-L77SYqkB3G56JV2eZ3N59_uzufLmUFVkXlzTomnnxFjNxKu5PM6ILUDztvIp7aT18FhA2APucWwZKSOocq3Q78lWw Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: 3e49151735934f21a2ea909842e36a05 Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:10:04.119992 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3e49151735934f21a2ea909842e36a05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e49151735934f21a2ea909842e36a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3e49151735934f21a2ea909842e36a05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e49151735934f21a2ea909842e36a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: 3e49151735934f21a2ea909842e36a05 Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-TestVolumeBootPattern-1713390008-project Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: afa6212f31034e27a8d32f114937190e Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-TestVolumeBootPattern-1713390008-project Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:10:04.121757 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': 'e4561748-1530-48b0-b782-1bceb2ecb240'} Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:10:04.122858 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:10:04.124281 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:10:04.125737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Returning 404 to user: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:10:04.125737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-7e8be496-85c6-4010-a14f-c1c7276b85dd tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 404 len: 111 microversion: 2.1 time: 0.029583 Sep 01 15:10:04.125737 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 532/1066] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:10:04 2022] DELETE /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:10:04.129995 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:04.130673 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] [instance: e4561748-1530-48b0-b782-1bceb2ecb240] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:04.137303 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:04.137798 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:04.138278 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:04.138959 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:04.139419 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:04.139851 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:04.155054 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.wsgi [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] HTTP exception thrown: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Request method failure captured: Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: request: GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 HTTP/1.1 Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept: application/json Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Accept-Encoding: identity Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Connection: close Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Length: 0 Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Content-Type: application/json Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Host: 10.222.0.33 Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: Openstack-System-Scope: None Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: User-Agent: python-urllib3/1.26.12 Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Auth-Token: gAAAAABjEMmM5arFh5_6MDEdv1X28eUF86VGRpd75Ifpn2OamslpHrHxi4vmRcBA83KmQJ7E-QGnspEfEbyeVLHxAlC8q-L77SYqkB3G56JV2eZ3N59_uzufLmUFVkXlzTomnnxFjNxKu5PM6ILUDztvIp7aT18FhA2APucWwZKSOocq3Q78lWw Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Id: None Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Domain-Name: None Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Identity-Status: Confirmed Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Is-Admin-Project: True Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Id: default Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Domain-Name: Default Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Id: 3e49151735934f21a2ea909842e36a05 Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Project-Name: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Role: member,reader Sep 01 15:10:04.156799 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Roles: member,reader Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3e49151735934f21a2ea909842e36a05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e49151735934f21a2ea909842e36a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3e49151735934f21a2ea909842e36a05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3e49151735934f21a2ea909842e36a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Id: 3e49151735934f21a2ea909842e36a05 Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-Tenant-Name: tempest-TestVolumeBootPattern-1713390008 Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User: tempest-TestVolumeBootPattern-1713390008-project Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Id: default Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Domain-Name: Default Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Id: afa6212f31034e27a8d32f114937190e Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: X-User-Name: tempest-TestVolumeBootPattern-1713390008-project Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: method: > Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: exception: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:10:04.159346 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: action_args: {'id': 'e4561748-1530-48b0-b782-1bceb2ecb240'} Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:10:04.160373 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. Sep 01 15:10:04.162026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: ERROR nova.api.openstack.wsgi Sep 01 15:10:04.163682 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Returning 404 to user: Instance e4561748-1530-48b0-b782-1bceb2ecb240 could not be found. {{(pid=120554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:10:04.163682 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-3103cdc3-4b4b-416d-8a4e-77fb3110a180 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240" status: 404 len: 111 microversion: 2.1 time: 0.032127 Sep 01 15:10:04.163682 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 535/1067] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:04 2022] GET /compute/v2.1/servers/e4561748-1530-48b0-b782-1bceb2ecb240 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 15:10:04.521116 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-8485b557-ca3d-4801-9526-60b73ecfd134 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:04.521657 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-8485b557-ca3d-4801-9526-60b73ecfd134 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:04.528083 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8485b557-ca3d-4801-9526-60b73ecfd134 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:04.528566 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8485b557-ca3d-4801-9526-60b73ecfd134 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:04.529005 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8485b557-ca3d-4801-9526-60b73ecfd134 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:04.529685 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8485b557-ca3d-4801-9526-60b73ecfd134 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:04.530144 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8485b557-ca3d-4801-9526-60b73ecfd134 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:04.530591 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-8485b557-ca3d-4801-9526-60b73ecfd134 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:04.661066 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-8485b557-ca3d-4801-9526-60b73ecfd134 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:10:04.669771 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-8485b557-ca3d-4801-9526-60b73ecfd134 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1464 microversion: 2.1 time: 0.152683 Sep 01 15:10:04.670340 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 533/1068] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:04 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:10:04.713857 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-91da785c-8ca8-4890-8fc0-2a5f86703e2f tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:04.714388 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-91da785c-8ca8-4890-8fc0-2a5f86703e2f tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120554) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:04.720644 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91da785c-8ca8-4890-8fc0-2a5f86703e2f tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:04.721130 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91da785c-8ca8-4890-8fc0-2a5f86703e2f tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:04.721568 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91da785c-8ca8-4890-8fc0-2a5f86703e2f tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:04.722318 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91da785c-8ca8-4890-8fc0-2a5f86703e2f tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:04.722783 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91da785c-8ca8-4890-8fc0-2a5f86703e2f tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:04.723212 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [None req-91da785c-8ca8-4890-8fc0-2a5f86703e2f tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:04.749467 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.compute.api [None req-91da785c-8ca8-4890-8fc0-2a5f86703e2f tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Going to try to terminate instance {{(pid=120554) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 15:10:04.797286 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG dbcounter [-] [120554] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 15:10:04.822334 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-91da785c-8ca8-4890-8fc0-2a5f86703e2f tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "DELETE /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 204 len: 0 microversion: 2.1 time: 0.112429 Sep 01 15:10:04.822946 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 536/1069] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 1 15:10:04 2022] DELETE /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 15:10:04.831410 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-2354ce12-0a4d-4946-9d8d-10be48b296ba tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:04.832170 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-2354ce12-0a4d-4946-9d8d-10be48b296ba tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:04.838650 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2354ce12-0a4d-4946-9d8d-10be48b296ba tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:04.839132 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2354ce12-0a4d-4946-9d8d-10be48b296ba tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:04.839577 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2354ce12-0a4d-4946-9d8d-10be48b296ba tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:04.840265 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2354ce12-0a4d-4946-9d8d-10be48b296ba tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:04.840722 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2354ce12-0a4d-4946-9d8d-10be48b296ba tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:04.841147 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-2354ce12-0a4d-4946-9d8d-10be48b296ba tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:04.965589 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-2354ce12-0a4d-4946-9d8d-10be48b296ba tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:10:04.973499 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-2354ce12-0a4d-4946-9d8d-10be48b296ba tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1470 microversion: 2.1 time: 0.145898 Sep 01 15:10:04.974055 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 534/1070] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:04 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:10:05.451872 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [None req-cc7003bf-d5c0-4819-814e-0f4cebd83201 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] Calling method '.version_select at 0x7fab73e81820>' {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:05.473026 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [None req-cc7003bf-d5c0-4819-814e-0f4cebd83201 tempest-TestVolumeBootPattern-1713390008 tempest-TestVolumeBootPattern-1713390008-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-971708312" status: 202 len: 0 microversion: 2.1 time: 0.026145 Sep 01 15:10:05.473772 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 537/1071] 10.222.0.33 () {58 vars in 1260 bytes} [Thu Sep 1 15:10:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-971708312 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 15:10:05.995272 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-322d29db-0167-46ef-acec-710df7fcdf33 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:05.996020 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-322d29db-0167-46ef-acec-710df7fcdf33 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:06.002166 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-322d29db-0167-46ef-acec-710df7fcdf33 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:06.002688 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-322d29db-0167-46ef-acec-710df7fcdf33 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:06.003129 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-322d29db-0167-46ef-acec-710df7fcdf33 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:06.003825 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-322d29db-0167-46ef-acec-710df7fcdf33 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:06.004288 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-322d29db-0167-46ef-acec-710df7fcdf33 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:06.004716 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-322d29db-0167-46ef-acec-710df7fcdf33 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:06.164643 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.policy [None req-322d29db-0167-46ef-acec-710df7fcdf33 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c138f1d6eb441228a9770f1c8c36778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd429d17d00c24f22b74b56446fcaf35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 15:10:06.173424 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-322d29db-0167-46ef-acec-710df7fcdf33 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 200 len: 1470 microversion: 2.1 time: 0.181985 Sep 01 15:10:06.173997 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 535/1072] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:05 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 15:10:06.597103 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG nova.api.openstack.wsgi [req-b3d22a45-c13f-4fcb-ab16-5a16ca24fa99 req-dae3af3d-7de3-42ed-9d72-7ab91da7a372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fa012c-6d65-486c-90be-e3431f3175a4", "name": "network-vif-deleted", "tag": "f8757685-ed8b-409e-bb11-1918e6318e29"}]} {{(pid=120554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 15:10:06.613685 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b3d22a45-c13f-4fcb-ab16-5a16ca24fa99 req-dae3af3d-7de3-42ed-9d72-7ab91da7a372 service nova] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:06.614176 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b3d22a45-c13f-4fcb-ab16-5a16ca24fa99 req-dae3af3d-7de3-42ed-9d72-7ab91da7a372 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:06.614626 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: DEBUG oslo_concurrency.lockutils [req-b3d22a45-c13f-4fcb-ab16-5a16ca24fa99 req-dae3af3d-7de3-42ed-9d72-7ab91da7a372 service nova] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:06.629547 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.compute.server_external_events [req-b3d22a45-c13f-4fcb-ab16-5a16ca24fa99 req-dae3af3d-7de3-42ed-9d72-7ab91da7a372 service nova] Creating event network-vif-deleted:f8757685-ed8b-409e-bb11-1918e6318e29 for instance 19fa012c-6d65-486c-90be-e3431f3175a4 on hv-cinder-85505 Sep 01 15:10:06.635975 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: INFO nova.api.openstack.requestlog [req-b3d22a45-c13f-4fcb-ab16-5a16ca24fa99 req-dae3af3d-7de3-42ed-9d72-7ab91da7a372 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043294 Sep 01 15:10:06.637221 dv-cinder-855058-2-iscsi devstack@n-api.service[120554]: [pid: 120554|app: 0|req: 538/1073] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 1 15:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 15:10:07.194910 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Calling method '>' {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 15:10:07.195775 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.compute.api [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] [instance: 19fa012c-6d65-486c-90be-e3431f3175a4] Fetching instance by UUID {{(pid=120553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 15:10:07.202247 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:07.202820 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:07.203348 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:07.204108 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Acquiring lock "af77895d-00fc-418a-9eb2-bcc92f66925d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 15:10:07.204660 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 15:10:07.205160 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG oslo_concurrency.lockutils [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Lock "af77895d-00fc-418a-9eb2-bcc92f66925d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 15:10:07.219071 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.wsgi [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] HTTP exception thrown: Instance 19fa012c-6d65-486c-90be-e3431f3175a4 could not be found. Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Request method failure captured: Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: request: GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 HTTP/1.1 Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept: application/json Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Accept-Encoding: identity Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Connection: close Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Length: 0 Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Content-Type: application/json Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Host: 10.222.0.33 Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: Openstack-System-Scope: None Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: User-Agent: python-urllib3/1.26.12 Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Auth-Token: gAAAAABjEMs73gI2PenBDqMoDnQ24VY2XPVpvvVYDzudZ_FYPAND5dXNknDlnPkx8PQtCWML4ZxA3lhGcUw6praKa7AYK7nH5-XrF7qNpiiZNMYU_UC7CL9BYb5WwexkGZSmhf80LWdouamAZxkSw_lmJzNruMNs8Td7AudvssPfclzU6FtopLA Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Id: None Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Domain-Name: None Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Identity-Status: Confirmed Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Is-Admin-Project: True Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Id: default Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Domain-Name: Default Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Id: d429d17d00c24f22b74b56446fcaf35a Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Project-Name: tempest-VolumesNegativeTest-1265275719 Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Role: member,reader Sep 01 15:10:07.220630 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Roles: member,reader Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d429d17d00c24f22b74b56446fcaf35a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d429d17d00c24f22b74b56446fcaf35a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d429d17d00c24f22b74b56446fcaf35a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d429d17d00c24f22b74b56446fcaf35a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}] Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant: tempest-VolumesNegativeTest-1265275719 Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Id: d429d17d00c24f22b74b56446fcaf35a Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-Tenant-Name: tempest-VolumesNegativeTest-1265275719 Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User: tempest-VolumesNegativeTest-1265275719-project Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Id: default Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Domain-Name: Default Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Id: 2c138f1d6eb441228a9770f1c8c36778 Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: X-User-Name: tempest-VolumesNegativeTest-1265275719-project Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: method: > Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: exception: Instance 19fa012c-6d65-486c-90be-e3431f3175a4 could not be found. Sep 01 15:10:07.222464 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: action_args: {'id': '19fa012c-6d65-486c-90be-e3431f3175a4'} Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: {{(pid=120553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19fa012c-6d65-486c-90be-e3431f3175a4 could not be found. Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 15:10:07.223488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19fa012c-6d65-486c-90be-e3431f3175a4 could not be found. Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19fa012c-6d65-486c-90be-e3431f3175a4 could not be found. Sep 01 15:10:07.225124 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: ERROR nova.api.openstack.wsgi Sep 01 15:10:07.226488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: DEBUG nova.api.openstack.wsgi [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] Returning 404 to user: Instance 19fa012c-6d65-486c-90be-e3431f3175a4 could not be found. {{(pid=120553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 15:10:07.226488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: INFO nova.api.openstack.requestlog [None req-18297af1-18d0-4acd-9dcf-4cae0e39fdf7 tempest-VolumesNegativeTest-1265275719 tempest-VolumesNegativeTest-1265275719-project] 10.222.0.33 "GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4" status: 404 len: 111 microversion: 2.1 time: 0.031544 Sep 01 15:10:07.226488 dv-cinder-855058-2-iscsi devstack@n-api.service[120553]: [pid: 120553|app: 0|req: 536/1074] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 1 15:10:07 2022] GET /compute/v2.1/servers/19fa012c-6d65-486c-90be-e3431f3175a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)